Where the Truth Lies: Explaining the Credibility of Emerging Claims on the Web and Social Media
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
The web is a huge source of valuable information. However, in recent times, there is an increasing trend towards false claims in social media, other web-sources, and even in news. Thus, factchecking websites have become increasingly popular to identify such misinformation based on manual analysis. Recent research proposed methods to assess the credibility of claims automatically. However, there are major limitations: most works assume claims to be in a structured form, and a few deal with textual claims but require that sources of evidence or counter-evidence are easily retrieved from the web. None of these works can cope with newly emerging claims, and no prior method can give user-interpretable explanations for its verdict on the claim's credibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prominent Features of Rumor Propagation in Online Social Media
Kwon, S., Cha, M., Jung, K., Chen, W., & Wang, Y. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.61 · Cited by 859 · cited 4×
“Most of the prior works on rumor propagation dealt with online social networks (e.g., Twitter) [12, 45] where it is easy to trace the information diffusion.”
BackgroundMethodInfluentialAutomatic detection of rumor on Sina Weibo
Yang, F., Liu, Y., Yu, X., & Yang, M. (2012) · Proceedings of the ACM SIGKDD Workshop on Mining Data Semantics · doi:10.1145/2350190.2350203 · Cited by 680 · cited 1×
“Prior research for credibility assessment of social media posts exploits community-specific features for detecting rumors, fake, and deceptive content [4, 13, 30, 39, 40].”
BackgroundGupta, A., Lamba, H., Kumaraguru, P., & Joshi, A. (2013) · Proceedings of the 22nd International Conference on World Wide Web Companion · doi:10.1145/2487788.2488033 · Cited by 573 · cited 1×
“[10] addresses the problem of detecting fake images in Twitter based on influence patterns and social reputation.”
BackgroundDisinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes
Kumar, S., West, R., & Leskovec, J. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883085 · Cited by 310 · cited 3×
“A study on Wikipedia hoaxes is done in [11].”
BackgroundRecognizing stances in online debates
Somasundaran, S., & Wiebe, J. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · doi:10.3115/1687878.1687912 · Cited by 303
Credibility Assessment of Textual Claims on the Web
Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G. (2016) · Proceedings of the 25th ACM International on Conference on Information and Knowledge Management · doi:10.1145/2983323.2983661 · Cited by 177
Self-citation
Research works printed but not linked: 35
- P. Bellot, A. Doucet, et al. Report on inex 2013. SIGIR Forum, 47(2):21--32, Jan. 2013. · doi:10.1145/2568388.2568393
- M.-A. Cartright, H. A. Feild, and J. Allan. Evidence finding using a collection of books. In BooksOnline 2011. · DOI
- C. Castillo, M. Mendoza, and B. Poblete. Information credibility on twitter. In WWW 2011. · DOI · Paper page
- X. L. Dong, L. Berti-Equille, and D. Srivastava. Integrating conflicting data: The role of source dependence. Proc. VLDB Endow., 2(1):550--561, 2009. · DOI · Paper page
- X. L. Dong, E. Gabrilovich, et al. Knowledge-based trust: Estimating the trustworthiness of web sources. Proc. VLDB Endow., 8(9):938--949, 2015. · DOI · Paper page
- X. L. Dong and D. Srivastava. Compact explanation of data fusion decisions. In WWW 2013. · DOI
- R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. LIBLINEAR: A library for large linear classification. JMLR, 2008.
- A. Galland, S. Abiteboul, A. Marian, and P. Senellart. Corroborating information from disagreeing views. In WSDM 2010. · DOI · Paper page
- Q. Li, Y. Li, J. Gao, L. Su, B. Zhao, M. Demirbas, W. Fan, and J. Han. A confidence-aware approach for truth discovery on long-tail data. Proc. VLDB Endow., 8(4), 2014. · DOI · Paper page
- Q. Li, Y. Li, J. Gao, B. Zhao, W. Fan, and J. Han. Resolving conflicts in heterogeneous data by truth discovery and source reliability estimation. In SIGMOD 2014. · DOI · Paper page
- X. Li, X. L. Dong, K. Lyons, W. Meng, and D. Srivastava. Truth finding on the deep web: Is the problem solved? PVLDB, 6(2):97--108, 2012. · DOI · Paper page
- X. Li, W. Meng, and C. Yu. T-verifier: Verifying truthfulness of fact statements. In ICDE 2011. · DOI
- Y. Li, Q. Li, J. Gao, L. Su, B. Zhao, W. Fan, and J. Han. On the discovery of evolving truth. In KDD 2015. · DOI · Paper page
- M. Lukasik, P. K. Srijith, D. Vu, K. Bontcheva, A. Zubiaga, and T. Cohn. Hawkes processes for continuous time sequence classification: an application to rumour stance classification in twitter. In ACL 2016. · DOI
- F. Ma, Y. Li, Q. Li, M. Qiu, J. Gao, S. Zhi, L. Su, B. Zhao, H. Ji, and J. Han. Faitcrowd: Fine grained truth discovery for crowdsourced data aggregation. In KDD 2015. · DOI · Paper page
- J. Ma, W. Gao, P. Mitra, S. Kwon, B. J. Jansen, K. Wong, and M. Cha. Detecting rumors from microblogs with recurrent neural networks. In IJCAI 2016.
- S. Mukherjee and G. Weikum. Leveraging joint interactions for credibility analysis in news communities. In CIKM 2015. · DOI
- S. Mukherjee, G. Weikum, and C. Danescu-Niculescu-Mizil. People on drugs: Credibility of user statements in health communities. In KDD 2014. · DOI
- N. Nakashole and T. M. Mitchell. Language-aware truth assessment of fact candidates. In ACL 2014. · DOI
- J. Pasternack and D. Roth. Knowing what to believe (when you already know something). In COLING 2010.
- J. Pasternack and D. Roth. Latent credibility analysis. In WWW 2013. · DOI · Paper page
- J. Pasternack and D. Roth. Making better informed trust decisions with generalized fact-finding. In IJCAI 2011. · DOI
- V. Qazvinian, E. Rosengren, D. R. Radev, and Q. Mei. Rumor has it: Identifying misinformation in microblogs. In EMNLP 2011.
- R. Rinott, L. Dankin, et al. Show me your evidence - an automatic method for context dependent evidence detection. In EMNLP 2015. · DOI · Paper page
- M. Samadi. Facts and Reasons: Anytime Web Information Querying to Support Agents and Human Decision Making. PhD thesis, Ph. D. Thesis, Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA, 2015.
- M. Samadi, P. Talukdar, M. Veloso, and M. Blum. Claimeval: Integrated and flexible framework for claim evaluation using credibility of sources. In AAAI 2016. · DOI
- D. Sridhar, L. Getoor, and M. Walker. Collective stance classification of posts in online debate forums. In ACL Joint Workshop on Social Dynamics and Personal Attributes in Social Media 2014. · DOI
- V. V. Vydiswaran, C. Zhai, and D. Roth. Content-driven trust propagation framework. In KDD 2011. · DOI
- M. A. Walker, P. Anand, R. Abbott, and R. Grant. Stance classification using dialogic properties of persuasion. In NAACL HLT 2012.
- Q. Xu and H. Zhao. Using deep linguistic features for finding deceptive opinion spam. In COLING 2012.
- A. Yates, N. Goharian, and O. Frieder. Extracting adverse drug reactions from social media. In AAAI 2015. · DOI
- X. Yin, J. Han, and P. S. Yu. Truth discovery with multiple conflicting information providers on the web. IEEE Trans. on Knowl. and Data Eng., 20(6):796--808, June 2008. · DOI · Paper page
- B. Zhao, B. I. P. Rubinstein, J. Gemmell, and J. Han. A bayesian approach to discovering truth from conflicting sources for data integration. Proc. VLDB Endow., 5(6):550--561, 2012. · DOI · Paper page
- S. Zhi, B. Zhao, W. Tong, J. Gao, D. Yu, H. Ji, and J. Han. Modeling truth existence in truth discovery. In KDD 2015. · DOI
- A. Zubiaga, G. W. S. Hoi, M. Liakata, R. Procter, and P. Tolmie. Analysing how people orient to and spread rumours in social media by looking at conversational threads. PLoS ONE, 11(3), 2016. · DOI · Paper page
Cited by
Combating Fake News: A Survey on Identification and Mitigation Techniques
Sharma, K., Qian, F., Jiang, H., Ruchansky, N., Zhang, M., & Liu, Y. (2019) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3305260 · Cited by 514
Fact or Fiction: Verifying Scientific Claims
Wadden, D., Lin, S., Lo, K., Wang, L. L., van Zuylen, M., Cohan, A., & Hajishirzi, H. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.609 · Cited by 382
“(Barr´on-Cede˜no et al., 2018), Verify (”Baly et al., 2018), F EVER (Thorne et al., 2018), and UKP Snopes (Hanselowski et al., 2019).”
MethodFake News Stance Detection Using Deep Learning Architecture (CNN-LSTM)
Umer, M., Imtiaz, Z., Ullah, S., Mehmood, A., Choi, G. S., & On, B.-W. (2020) · IEEE Access · doi:10.1109/access.2020.3019735 · Cited by 327
DeClarE: Debunking Fake News and False Claims using Evidence-Aware Deep Learning
Popat, K., Mukherjee, S., Yates, A., & Weikum, G. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1003 · Cited by 315
Self-citationFANG: Leveraging Social Context for Fake News Detection Using Graph Representation
Nguyen, V.-H., Sugiyama, K., Nakov, P., & Kan, M.-Y. (2020) · Proceedings of the 29th ACM International Conference on Information & Knowledge Management · doi:10.1145/3340531.3412046 · Cited by 270
Metadata
- Authors
- Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G.
- Venue
- Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion
- Publisher
- ACM Press
- Published
- 2017
- Pages
- 1003-1012
- OpenAlex
- W2594382603
- Cited by
- 213
- References
- 6
- FWCI
- 95.46
- Type
- conference paper
- Language
- en
- Open access
- gold
- Funders
- ERC Synergy Grant (imPACT) (610150)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.