Cited by 30Misinformation and Its ImpactsSocial Media and PoliticsComplex Network Analysis Techniques

Engagement with fact-checked posts on Reddit

Open access
Bond, Robert M, Garrett, R Kelly·2023·PNAS Nexus

Abstract

Contested factual claims shared online are of increasing interest to scholars and the public. Characterizing temporal patterns of sharing and engagement with such information, as well as the effect of sharing associated fact-checks, can help us understand the online political news environment more fully. Here, we investigate differential engagement with fact-checked posts shared online via Reddit from 2016 to 2018. The data comprise ∼29,000 conversations, ∼849,000 users, and ∼9.8 million comments. We classified the veracity of the posts being discussed as true, mixed, or false using three fact-checking organizations. Regardless of veracity, fact-checked posts had larger and longer lasting conversations than claims that were not fact-checked. Among those that were fact-checked, posts rated as false were discussed less and for shorter periods of time than claims that were rated as true. We also observe that fact-checks of posts rated as false tend to happen more quickly than fact-checks of posts rated as true. Finally, we observe that thread deletion and removal are systematically related to the presence of a fact-check and the veracity of the fact-check, but when deletion and removal are combined the differences are minimal. Theoretical and practical implications of the findings are discussed.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/pnasnexus/pgad018

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • True news is more likely to generate engagement than false news on Reddit.

    “Additionally, true news is more likely to generate engagement than false news on Reddit (Bond & Garrett 2023).”

    From Social Media and Morality. (2024) · cites this paper as Bond & Garrett 2023

    The Discussion reports lower engagement for fact-checked Reddit posts whose information was false than for those whose information was true. The claim omits that the study examined posts eliciting fact-checking comments, so it extends the finding to Reddit news generally. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 19

  1. [1]Allcott H, Gentzkow M. 2018. Social media and fake news in the 2016 election. J Econ Perspect. 31(2): 211– 236.
  2. [2]Grinberg N, Joseph K, Friedland L, Swire-Thompson B, Lazer D. 2019. Fake news on twitter during the 2016 U.S. presidential election. Science. 363(6425): 374– 378. 30679368
  3. [3]Guess A, Nagler J, Tucker J. 2019. Less than you think: prevalence and predictors of fake news dissemination on facebook. Sci Adv. 5(1): eeaau4586. PMC6326755 30662946
  4. [4]Lazer DMJ, et al 2018. The science of fake news. Science. 359(6380): 1094– 1096. 29590025
  5. [6]Ayres JM. 1999. From the streets to the internet: the cyber-diffusion of contention. Ann Am Acad Pol Soc Sci. 566(1): 132– 143.
  6. [7]Katz JE. 1998. Struggle in cyberspace: fact and friction on the world wide web. Ann Am Acad Pol Soc Sci. 560(1): 194– 199.
  7. [9]Bijker WE, Hughes TP, Pinch TJ. 1987. The social construction of technical systems: new directions in the sociology and history of technology. Cambridge: MIT Press.
  8. [11]Graham T, Broersma M, Hazelhoff K, van’t Haar G. 2013. Between broadcasting political messages and interacting with voters: the use of twitter during the 2010 UK general election campaign. Inf Commun Soc. 16(5): 692– 716.
  9. [12]Bakshy E, Hofman JM, Mason WA, Watts DJ. 2011. Everyone’s an influencer: quantifying influence on twitter. WSDM ’11: Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, Hong Kong. p. 65–74.
  10. [13]Theoccharis Y, Barberá P, Fazekas Z, Popa SA, Parnet O. 2016. A bad workman blames his tweets: the consequences of citizens’ uncivil twitter use when interacting with party candidates. J Commun. 66(6): 1007– 1031.
  11. [15]Reicher S, Spears R, Postmes T. 1995. A social identity model of deindividuation phenomena. Eur Rev Soc Psychol. 6(1): 161– 198.
  12. [16]Budak C, Garrett RK, Resnick P, Kamin J. 2017. Threading is sticky: how threaded conversations promote comment system user retention. Proc ACM Hum-Comput Interact. 1: 1– 20.
  13. [17]Eveland Jr WP. 2003. A “mix of attributes” approach to the study of media effects and new communication technologies. J Commun. 53(3): 395– 410.
  14. [18]Friess D, Eilders C. 2015. A systematic review of online deliberation research. Policy Internet. 7(3): 319– 339.
  15. [19]Jaidka K, Zhou A, Lelkes Y. 2019. Brevity is the soul of twitter: the constraint affordance and political discussion. J Commun. 69(4): 345– 372.
  16. [21]Rajadesingan A, Resnick P, Budak C. 2017. Quick, community-specific learning: how distinctive toxicity norms are maintained in political subreddits. Proc Int AAAI Conf Web Soci Media. 14(1): 557– 568.
  17. [22]Chandrasekharan E, et al 2018. The internet’s hidden rules: an empirical study of Reddit norm violations at micro, meso, and macro scales. Proc ACM Hum-Comput Interact. 2: 1– 25.
  18. [24]Friggeri A, Adamic LA, Eckles D, Cheng J. 2014. Rumor cascades. Proceedings of the Eighth International AAAI Conference on Weblogs and Social Media, Ann Arbor (MI). p. 101–110.
  19. [27]Shatz I. 2016. Fast, free, and targeted: Reddit as a source for recruiting participants online. Soc Sci Comput Rev. 35(4): 537– 549.

Cited by

Sorted by citations

Authors
Bond, R. M., & Garrett, R. K.
Affiliations
The Ohio State University (US)
Corresponding author
Bond, Robert M
Venue
PNAS Nexus
Published
2023-01-27
Volume
2
Issue
3
Pages
pgad018-pgad018
ISSN
2752-6542 (ISSN-L)
OpenAlex
W4318333070
Cited by
30
References
3
Citations by year
2026: 3 · 2025: 20 · 2024: 4 · 2023: 3
FWCI
13.32
Type
journal article
Language
en
Open access
Locations
  • PNAS Nexus (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Social Sciences › Communication › Social Media and Politics
  • Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Complex Network Analysis Techniques
Keywords
fact-checking, Reddit, online engagement, misinformation, factual claims, political news, online discourse, content removal

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review