CoChat

Web-based statistical fact checking of textual documents

Magdy, Amr, Wanas, Nayer · 2010 · Proceedings of the 2nd international workshop on Search and mining user-generated contents

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.

Abstract

User generated content has been growing tremendously in recent years. This content reflects the interests and the diversity of online users. In turn, the diversity among internet users is also reflected in the quality of the content being published online. This increases the need to develop means to gauge the support available for content posted online. In this work, we aim to make use of the web-content to calculate a statistical support score for textual documents. In the proposed algorithm, phrases representing key facts are extracted to construct basic elements of the document. Search is used thereon to validate the support available for these elements online, leading to assigning an overall score for each document. Experimental results have shown a difference between the score distribution of factual news data and false facts data. This indicates that the approach seems to be a promising seed for distinguishing different articles based on the content.

Overview

Integrity signals

Registry

Crossref · 10.1145/1871985.1872002

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 1

  1. Stvilia , B. , Twidale , M. , Gasser , L. , and Smith , L . 2005.Information quality discussions in Wikipedia , In Proceedings of the 2005 International Conference on Knowledge Management (Charlotte, NC, USA, October 27-28, 2005) ICKM2005. 101--113 . Stvilia, B., Twidale, M., Gasser, L., and Smith, L. 2005.Information quality discussions in Wikipedia, In Proceedings of the 2005 International Conference on Knowledge Management (Charlotte, NC, USA, October 27-28, 2005) ICKM2005. 101--113.

Cited by

See all 59

Metadata

Authors
Magdy, A., & Wanas, N.
Affiliations
  • Alexandria University (EG)
  • Cairo Microsoft Innovation Laboratory, Cairo, Egypt
Venue
Proceedings of the 2nd international workshop on Search and mining user-generated contents
Publisher
ACM
Published
2010-10-30
Pages
103-110
OpenAlex
W1969944630
Cited by
59
References
17
Citations by year
2025: 1 · 2024: 5 · 2023: 5 · 2022: 6 · 2021: 10 · 2020: 6 · 2019: 15 · 2018: 7 · 2017: 3 · 2013: 1
FWCI
0.94
Type
conference paper
Language
en
Open access
closed
Locations
International Workshop on Search and Mining User-Generated Contents (SMUC) (publishedVersion)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords
fact-checking, user-generated content, web search, keyword extraction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.