The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
DeClarE: Debunking Fake News and False Claims using Evidence-Aware Deep Learning
Open accessAbstract
Misinformation such as fake news is one of the big challenges of our society.Research on automated fact-checking has proposed methods based on supervised learning, but these approaches do not consider external evidence apart from labeled training instances.Recent approaches counter this deficit by considering external sources related to a claim.However, these methods require substantial feature modeling and rich lexicons.This paper overcomes these limitations of prior work with an end-toend model for evidence-aware credibility assessment of arbitrary textual claims, without any human intervention.It presents a neural network model that judiciously aggregates signals from external evidence articles, the language of these articles and the trustworthiness of their sources.It also derives informative features for generating user-comprehensible explanations that makes the neural network predictions transparent to the end-user.Experiments with four datasets and ablation studies show the strength of our method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
Wang, W. Y. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2067 · Cited by 1,516
Detecting rumors from microblogs with recurrent neural networks
Ma, J., Gao, W. G., Mitra, P., Kwon, S., Jansen, B. J. J., Wong, K., & Cha, M. (2016) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 1,097
CSI: A Hybrid Deep Model for Fake News Detection
Ruchansky, N., Seo, S., & Liu, Y. (2017) · Proceedings of the 2017 ACM on Conference on Information and Knowledge Management · doi:10.1145/3132847.3132877 · Cited by 1,039
Bidirectional LSTM Networks for Improved Phoneme Classification and Recognition
Graves, A., Fernández, S., & Schmidhuber, J. (2005) · Lecture Notes in Computer Science · doi:10.1007/11550907_126 · Cited by 925
Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
Rashkin, H., Choi, E., Jang, J. Y., Volkova, S., & Choi, Y. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1317 · Cited by 870
(2011) · Cited by 724
Automatic detection of rumor on Sina Weibo
Yang, F., Liu, Y., Yu, X., & Yang, M. (2012) · Proceedings of the ACM SIGKDD Workshop on Mining Data Semantics · doi:10.1145/2350190.2350203 · Cited by 680 · cited 2×
“Approaches like (Castillo et al., 2011; Qazvinian et al., 2011; Yang et al., 2012; Xu and Zhao, 2012; Gupta et al., 2013; Zhao et al., 2015; Volkova et al., 2017) propose supervised methods for detecting deceptive content in social media platforms like Twitter, Sina Weibo, etc. Similarly,…”
MethodTruth Discovery with Multiple Conflicting Information Providers on the Web
Yin, X., Han, J., & Yu, P. S. (2008) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2007.190745 · Cited by 648
Enquiring Minds: Early Detection of Rumors in Social Media from Enquiry Posts
Zhao, Z., Resnick, P., & Mei, Q. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2736277.2741637 · Cited by 583
Gupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2013) · Proceedings of the 22nd International Conference on World Wide Web Companion · doi:10.1145/2487788.2488033 · Cited by 573 · cited 2×
“Approaches like (Castillo et al., 2011; Qazvinian et al., 2011; Yang et al., 2012; Xu and Zhao, 2012; Gupta et al., 2013; Zhao et al., 2015; Volkova et al., 2017) propose supervised methods for detecting deceptive content in social media platforms like Twitter, Sina Weibo, etc. Similarly,…”
MethodCreating Subjective and Objective Sentence Classifiers from Unannotated Texts
Wiebe, J., & Riloff, E. (2005) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30586-6_53 · Cited by 545
Volkova, S., Shaffer, K., Jang, J. Y., & Hodas, N. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2102 · Cited by 381
A confidence-aware approach for truth discovery on long-tail data
Li, Q., Li, Y., Gao, J., Su, L., Zhao, B., Demirbas, M., Fan, W., & Han, J. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2735496.2735505 · Cited by 353
Li, Y., Gao, J., Meng, C., Li, Q., Su, L., Zhao, B., Fan, W., & Han, J. (2016) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2897350.2897352 · Cited by 336
SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours
Derczynski, L., Bontcheva, K., Liakata, M., Procter, R., Wong Sak Hoi, G., & Zubiaga, A. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2006 · Cited by 323
Integrating conflicting data: the role of source dependence
Dong, X. L., Berti-Equille, L., & Srivastava, D. (2009) · Proceedings of the VLDB Endowment · doi:10.14778/1687627.1687690 · Cited by 312
Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes
Kumar, S., West, R., & Leskovec, J. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883085 · Cited by 310 · cited 1×
“Kumar et al. (2016) studies the problem of detecting hoax articles on Wikipedia.”
BackgroundLinguistic Models for Analyzing and Detecting Biased Language
Recasens, M. V., Danescu-Niculescu-Mizil, C., & Jurafsky, D. (2013) · Cited by 297
SemEval-2019 Task 7: RumourEval, Determining Rumour Veracity and Support for Rumours
Gorrell, G., Kochkina, E., Liakata, M., Aker, A., Zubiaga, A., Bontcheva, K., & Derczynski, L. (2019) · Proceedings of the 13th International Workshop on Semantic Evaluation · doi:10.18653/v1/s19-2147 · Cited by 219
Where the Truth Lies: Explaining the Credibility of Emerging Claims on the Web and Social Media
Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G. (2017) · Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion · doi:10.1145/3041021.3055133 · Cited by 213
Self-citationFaitCrowd: Fine Grained Truth Discovery for Crowdsourced Data Aggregation
Ma, F., Li, Y., Li, Q., Qiu, M., Gao, J., Zhi, S., Su, L., Zhao, B., Ji, H., & Han, J. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783314 · Cited by 186
Credibility Assessment of Textual Claims on the Web
Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983661 · Cited by 177
Self-citationPasternack, J., & Roth, D. (2013) · Proceedings of the 22nd international conference on World Wide Web · doi:10.1145/2488388.2488476 · Cited by 162
Knowledge-based trust: estimating the trustworthiness of web sources
Dong, X. L., Gabrilovich, E., Murphy, K., Dang, V., Horn, W., Lugaresi, C., Sun, S., & Zhang, W. (2015) · Proceedings of the VLDB Endowment · doi:10.14778/2777598.2777603 · Cited by 129
On the Discovery of Evolving Truth
Li, Y., Li, Q., Gao, J., Su, L., Zhao, B., Fan, W., & Han, J. (2015) · Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2783258.2783277 · Cited by 115
Leveraging Joint Interactions for Credibility Analysis in News Communities
Mukherjee, S., & Weikum, G. (2015) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2806416.2806537 · Cited by 101
Self-citationNileTMRG at SemEval-2017 Task 8: Determining Rumour and Veracity Support for Rumours on Twitter.
Enayet, O., & El-Beltagy, S. R. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2082 · Cited by 100
Language-Aware Truth Assessment of Fact Candidates
Nakashole, N., & Mitchell, T. M. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1095 · Cited by 90
Using Deep Linguistic Features for Finding Deceptive Opinion Spam
Xu, Q., & Zhao, H. (2012) · Cited by 82
Content-driven trust propagation framework
Vydiswaran, V. G. V., Zhai, C., & Roth, D. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020567 · Cited by 69
Modeling Truth Existence in Truth Discovery
Zhi, S., Zhao, B., Tong, W., Gao, J., Yu, D., Ji, H., & Han, J. (2015) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2783258.2783339 · Cited by 54
T-verifier: Verifying truthfulness of fact statements
Li, X., Meng, W., & Yu, C. T. (2011) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.2011.5767859 · Cited by 48
Sentence Subjectivity Detection with Weakly-Supervised Learning
Lin, C., He, Y., & Everson, R. (2011) · Open Research Online (The Open University) · Cited by 44
Truth discovery and crowdsourcing aggregation
Gao, J., Li, Q., Zhao, B., Fan, W., & Han, J. (2015) · Proceedings of the VLDB Endowment · doi:10.14778/2824032.2824136 · Cited by 40
ClaimEval: Integrated and Flexible Framework for Claim Evaluation Using Credibility of Sources
Samadi, M., Talukdar, P. P., Veloso, M., & Blum, M. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9996 · Cited by 34
People on Drugs: Credibility of User Statements in Health CommunitiesPreprint
Mukherjee, S., Weikum, G., & Danescu-Niculescu-Mizil, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.02522 · Cited by 24
Self-citationIITP at SemEval-2017 Task 8 : A Supervised Approach for Rumour Evaluation
Singh, V., Narayan, S., Akhtar, M. S., Ekbal, A., & Bhattacharyya, P. (2017) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/s17-2087 · Cited by 23
Cited by
Survey of Hallucination in Natural Language Generation
Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Madotto, A., & Fung, P. (2023) · ACM Computing Surveys · doi:10.1145/3571730 · Cited by 5,025
“, web traffic, PageRank or URL structure) have been proposed to deal with this trustworthiness issue [7, 144, 145].”
BackgroundHate speech detection: Challenges and solutions
MacAvaney, S., Yao, H.-R., Yang, E., Russell, K., Goharian, N., & Frieder, O. (2019) · PLOS ONE · doi:10.1371/journal.pone.0221152 · Cited by 566
Fake news detection: A hybrid CNN-RNN based deep learning approach
Nasir, J. A., Khan, O. S., & Varlamis, I. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2020.100007 · Cited by 565
A Survey on Automated Fact-Checking
Guo, Z., Schlichtkrull, M., & Vlachos, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00454 · Cited by 500
Deep learning for misinformation detection on online social networks: a survey and new perspectives
Islam, M. R., Liu, S., Wang, X., & Xu, G. (2020) · Social Network Analysis and Mining · doi:10.1007/s13278-020-00696-x · Cited by 289
Metadata
- Authors
- Popat, K., Mukherjee, S., Yates, A., & Weikum, G.
- Venue
- Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
- Published
- 2018
- Pages
- 22-32
- OpenAlex
- W2890801081
- Cited by
- 315
- References
- 40
- FWCI
- 105.39
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.