CoChat

BuzzFace: A News Veracity Dataset with Facebook User Commentary and Egos

Open access
Santia, Giovanni, Williams, Jake · 2018 · Proceedings of the International AAAI Conference on Web and Social Media
Cited by 100

The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.

Abstract

Veracity assessment of news and social bot detection have become two of the most pressing issues for social media platforms, yet current gold-standard data are limited. This paper presents a leap forward in the development of a sizeable and feature rich gold-standard dataset. The dataset was built by using a collection of news items posted to Facebook by nine news outlets during September 2016, which were annotated for veracity by BuzzFeed. These articles were refined beyond binary annotation to the four categories: mostly true, mostly false, mixture of true and false, and no factual content. Our contribution integrates data on Facebook comments and reactions publicly available on the platform’s Graph API, and provides tailored tools for accessing news article web content. The features of the accessed articles include body text, images, links, Facebook plugin comments, Disqus plugin comments, and embedded tweets. Embedded tweets provide a potent possible avenue for expansion across social media platforms. Upon development, this utility yielded over 1.6 million text items, making it over 400 times larger than the current gold-standard. The resulting dataset—BuzzFace—is presently the most extensive created, and allows for more robust machine learning applications to news veracity assessment and social bot detection than ever before.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1609/icwsm.v12i1.14985

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

  • Fact Checking: Task definition and dataset construction

    Vlachos, A., & Riedel, S. (2014) · Proceedings of the ACL 2014 Workshop on Language Technologies and Computational Social Science · doi:10.3115/v1/w14-2508 · Cited by 402 · cited 1×

    “Similar to LIAR is the dataset detailed in (Vlachos and Riedel 2014) but this is quite a bit smaller at 106 short text items.”
    Method
  • SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours

    Derczynski, L., Bontcheva, K., Liakata, M., Procter, R., Wong Sak Hoi, G., & Zubiaga, A. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2006 · Cited by 323 · cited 4×

    “Moreover, the shared task associated with these data resulted in none of the 13 submitted systems outperforming a baseline of random assessment by the rate of false rumors (Derczynski et al. 2017).”
    BackgroundMethodInfluential

Show all 2 references

Cited by

See all 100

Metadata

Authors
Santia, G., & Williams, J.
Venue
Proceedings of the International AAAI Conference on Web and Social Media
Published
2018-06-15
Volume
12
Issue
1
Pages
531-540
ISSN
  • 2162-3449 (ISSN-L)
  • 2334-0770
OpenAlex
W2810121253
Cited by
100
References
2
FWCI
43.85
Type
conference paper
Language
en
Open access
diamond

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: BuzzFace: A News Veracity Dataset with Facebook User Commentary and Egos. https://app.cochat.ai/papers/10.1609/icwsm.v12i1.14985
The paper
Santia, G., & Williams, J. (2018). BuzzFace: A News Veracity Dataset with Facebook User Commentary and Egos. Proceedings of the International AAAI Conference on Web and Social Media. https://doi.org/10.1609/icwsm.v12i1.14985

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.