CoChat

Where the Truth Lies: Explaining the Credibility of Emerging Claims on the Web and Social Media

Open access
Popat, Kashyap, Mukherjee, Subhabrata, Strötgen, Jannik, Weikum, Gerhard · 2017 · Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion
Cited by 213

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

The web is a huge source of valuable information. However, in recent times, there is an increasing trend towards false claims in social media, other web-sources, and even in news. Thus, factchecking websites have become increasingly popular to identify such misinformation based on manual analysis. Recent research proposed methods to assess the credibility of claims automatically. However, there are major limitations: most works assume claims to be in a structured form, and a few deal with textual claims but require that sources of evidence or counter-evidence are easily retrieved from the web. None of these works can cope with newly emerging claims, and no prior method can give user-interpretable explanations for its verdict on the claim's credibility.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3041021.3055133

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 35

  1. P. Bellot, A. Doucet, et al. Report on inex 2013. SIGIR Forum, 47(2):21--32, Jan. 2013. · doi:10.1145/2568388.2568393
  2. M.-A. Cartright, H. A. Feild, and J. Allan. Evidence finding using a collection of books. In BooksOnline 2011. · DOI
  3. C. Castillo, M. Mendoza, and B. Poblete. Information credibility on twitter. In WWW 2011. · DOI · Paper page
  4. X. L. Dong, L. Berti-Equille, and D. Srivastava. Integrating conflicting data: The role of source dependence. Proc. VLDB Endow., 2(1):550--561, 2009. · DOI · Paper page
  5. X. L. Dong, E. Gabrilovich, et al. Knowledge-based trust: Estimating the trustworthiness of web sources. Proc. VLDB Endow., 8(9):938--949, 2015. · DOI · Paper page
  6. X. L. Dong and D. Srivastava. Compact explanation of data fusion decisions. In WWW 2013. · DOI
  7. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin. LIBLINEAR: A library for large linear classification. JMLR, 2008.
  8. A. Galland, S. Abiteboul, A. Marian, and P. Senellart. Corroborating information from disagreeing views. In WSDM 2010. · DOI · Paper page
  9. Q. Li, Y. Li, J. Gao, L. Su, B. Zhao, M. Demirbas, W. Fan, and J. Han. A confidence-aware approach for truth discovery on long-tail data. Proc. VLDB Endow., 8(4), 2014. · DOI · Paper page
  10. Q. Li, Y. Li, J. Gao, B. Zhao, W. Fan, and J. Han. Resolving conflicts in heterogeneous data by truth discovery and source reliability estimation. In SIGMOD 2014. · DOI · Paper page
  11. X. Li, X. L. Dong, K. Lyons, W. Meng, and D. Srivastava. Truth finding on the deep web: Is the problem solved? PVLDB, 6(2):97--108, 2012. · DOI · Paper page
  12. X. Li, W. Meng, and C. Yu. T-verifier: Verifying truthfulness of fact statements. In ICDE 2011. · DOI
  13. Y. Li, Q. Li, J. Gao, L. Su, B. Zhao, W. Fan, and J. Han. On the discovery of evolving truth. In KDD 2015. · DOI · Paper page
  14. M. Lukasik, P. K. Srijith, D. Vu, K. Bontcheva, A. Zubiaga, and T. Cohn. Hawkes processes for continuous time sequence classification: an application to rumour stance classification in twitter. In ACL 2016. · DOI
  15. F. Ma, Y. Li, Q. Li, M. Qiu, J. Gao, S. Zhi, L. Su, B. Zhao, H. Ji, and J. Han. Faitcrowd: Fine grained truth discovery for crowdsourced data aggregation. In KDD 2015. · DOI · Paper page
  16. J. Ma, W. Gao, P. Mitra, S. Kwon, B. J. Jansen, K. Wong, and M. Cha. Detecting rumors from microblogs with recurrent neural networks. In IJCAI 2016.
  17. S. Mukherjee and G. Weikum. Leveraging joint interactions for credibility analysis in news communities. In CIKM 2015. · DOI
  18. S. Mukherjee, G. Weikum, and C. Danescu-Niculescu-Mizil. People on drugs: Credibility of user statements in health communities. In KDD 2014. · DOI
  19. N. Nakashole and T. M. Mitchell. Language-aware truth assessment of fact candidates. In ACL 2014. · DOI
  20. J. Pasternack and D. Roth. Knowing what to believe (when you already know something). In COLING 2010.
  21. J. Pasternack and D. Roth. Latent credibility analysis. In WWW 2013. · DOI · Paper page
  22. J. Pasternack and D. Roth. Making better informed trust decisions with generalized fact-finding. In IJCAI 2011. · DOI
  23. V. Qazvinian, E. Rosengren, D. R. Radev, and Q. Mei. Rumor has it: Identifying misinformation in microblogs. In EMNLP 2011.
  24. R. Rinott, L. Dankin, et al. Show me your evidence - an automatic method for context dependent evidence detection. In EMNLP 2015. · DOI · Paper page
  25. M. Samadi. Facts and Reasons: Anytime Web Information Querying to Support Agents and Human Decision Making. PhD thesis, Ph. D. Thesis, Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA, 2015.
  26. M. Samadi, P. Talukdar, M. Veloso, and M. Blum. Claimeval: Integrated and flexible framework for claim evaluation using credibility of sources. In AAAI 2016. · DOI
  27. D. Sridhar, L. Getoor, and M. Walker. Collective stance classification of posts in online debate forums. In ACL Joint Workshop on Social Dynamics and Personal Attributes in Social Media 2014. · DOI
  28. V. V. Vydiswaran, C. Zhai, and D. Roth. Content-driven trust propagation framework. In KDD 2011. · DOI
  29. M. A. Walker, P. Anand, R. Abbott, and R. Grant. Stance classification using dialogic properties of persuasion. In NAACL HLT 2012.
  30. Q. Xu and H. Zhao. Using deep linguistic features for finding deceptive opinion spam. In COLING 2012.
  31. A. Yates, N. Goharian, and O. Frieder. Extracting adverse drug reactions from social media. In AAAI 2015. · DOI
  32. X. Yin, J. Han, and P. S. Yu. Truth discovery with multiple conflicting information providers on the web. IEEE Trans. on Knowl. and Data Eng., 20(6):796--808, June 2008. · DOI · Paper page
  33. B. Zhao, B. I. P. Rubinstein, J. Gemmell, and J. Han. A bayesian approach to discovering truth from conflicting sources for data integration. Proc. VLDB Endow., 5(6):550--561, 2012. · DOI · Paper page
  34. S. Zhi, B. Zhao, W. Tong, J. Gao, D. Yu, H. Ji, and J. Han. Modeling truth existence in truth discovery. In KDD 2015. · DOI
  35. A. Zubiaga, G. W. S. Hoi, M. Liakata, R. Procter, and P. Tolmie. Analysing how people orient to and spread rumours in social media by looking at conversational threads. PLoS ONE, 11(3), 2016. · DOI · Paper page

Cited by

See all 213

Metadata

Authors
Popat, K., Mukherjee, S., Strötgen, J., & Weikum, G.
Venue
Proceedings of the 26th International Conference on World Wide Web Companion - WWW '17 Companion
Publisher
ACM Press
Published
2017
Pages
1003-1012
OpenAlex
W2594382603
Cited by
213
References
6
FWCI
95.46
Type
conference paper
Language
en
Open access
gold
Funders
ERC Synergy Grant (imPACT) (610150)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.