Higher Ground? How Groundtruth Labeling Impacts Our Understanding of Fake News about the 2016 U.S. Presidential Nominees
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
The spread of fake news on social media platforms has garnered much public attention and apprehension. Consequently, both the tech industry and academia alike are investing increased effort to understand, detect, and curb fake news. Yet, researchers differ in what they consider to be fake news sites. In this paper, we first aggregate 5 lists of fake and 3 of mainstream news sites published by experts and reputable organizations. Then, focusing on tweets about the democratic (Hillary Clinton) and republican (Donald Trump) nominees in the 2016 U.S. presidential election, we use each pair of fake and traditional news lists as an independent “groundtruth” to examine i) the prevalence, ii) temporal characteristics and iii) the agenda-setting differences between fake and traditional news sites. We observe that depending on the groundtruth, the prevalence of fake news varies significantly. However, the temporal trends and agenda-setting differences between fake and mainstream news sites remain moderately consistent across different groundtruth lists.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847
Social Media and Fake News in the 2016 Election
Allcott, H., & Gentzkow, M. (2017) · Journal of Economic Perspectives · doi:10.1257/jep.31.2.211 · Cited by 6,767
Answering the Call for a Standard Reliability Measure for Coding Data
Hayes, A. F., & Krippendorff, K. (2007) · Communication Methods and Measures · doi:10.1080/19312450709336664 · Cited by 4,225
Fake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
Cited by
Fake news detection based on news content and social contexts: a transformer-based approach
Raza, S., & Ding, C. (2022) · International Journal of Data Science and Analytics · doi:10.1007/s41060-021-00302-z · Cited by 285
Misunderstanding the harms of online misinformation
Budak, C., Nyhan, B., Rothschild, D. M., Thorson, E., & Watts, D. J. (2024) · Nature · doi:10.1038/s41586-024-07417-w · Cited by 156
Self-citationFlamino, J., Galeazzi, A., Feldman, S., Macy, M. W., Cross, B., Zhou, Z., Serafino, M., Bovet, A., Makse, H. A., & Szymanski, B. K. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01550-8 · Cited by 113
Metadata
- Authors
- Bozarth, L., Saraf, A., & Budak, C.
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2020-05-26
- Volume
- 14
- Pages
- 48-59
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W3011755849
- Cited by
- 40
- References
- 4
- FWCI
- 10.00
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Higher Ground? How Groundtruth Labeling Impacts Our Understanding of Fake News about the 2016 U.S. Presidential Nominees. https://app.cochat.ai/papers/10.1609/icwsm.v14i1.7278
- The paper
- Bozarth, L., Saraf, A., & Budak, C. (2020). Higher Ground? How Groundtruth Labeling Impacts Our Understanding of Fake News about the 2016 U.S. Presidential Nominees. Proceedings of the International AAAI Conference on Web and Social Media. https://doi.org/10.1609/icwsm.v14i1.7278
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.