Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 34 of the 38 references it cites were found in a registry or an index.

Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes

Kumar, Srijan, West, Robert, Leskovec, Jure · 2016 · Proceedings of the 25th International Conference on World Wide Web

Abstract

Wikipedia is a major source of information for many people. However, false information on Wikipedia raises concerns about its credibility. One way in which false information may be presented on Wikipedia is in the form of hoax articles, i.e., articles containing fabricated facts about nonexistent entities or events. In this paper we study false information on Wikipedia by focusing on the hoax articles that have been created throughout its history. We make several contributions. First, we assess the real-world impact of hoax articles by measuring how long they survive before being debunked, how many pageviews they receive, and how heavily they are referred to by documents on the Web. We find that, while most hoaxes are detected quickly and have little impact on Wikipedia, a small number of hoaxes survive long and are well cited across the Web. Second, we characterize the nature of successful hoaxes by comparing them to legitimate articles and to failed hoaxes that were discovered shortly after being created. We find characteristic differences in terms of article structure and content, embeddedness into the rest of Wikipedia, and features of the editor who created the hoax. Third, we successfully apply our findings to address a series of classification tasks, most notably to determine whether a given article is a hoax. And finally, we describe and evaluate a task involving humans distinguishing hoaxes from non-hoaxes. We find that humans are not particularly good at the task and that our automated classifier outperforms them by a big margin.

Overview

Integrity signals

Registry

Crossref · 10.1145/2872427.2883085

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 38 references

Research works printed but not linked: 5

  1. R. DeNardo. The Captain's Propensity: The Andromeda Incident II. Strategic Book Publishing, 2013.
  2. H. Frankfurt. On bullshit. Raritan Quarterly Review, 6(2):81--100, 1986.
  3. 10.1002/asi.v58:13 · doi:10.1002/asi.v58:13
  4. K. Morris. After a half-decade, massive Wikipedia hoax finally exposed. Website, 2013. http://www.dailydot.com/news/wikipedia-bicholim-conflict-hoax-deleted (accessed Oct. 16, 2015).
  5. 10.5555/2145432.2145602 · doi:10.5555/2145432.2145602

Cited by

See all 310

Metadata

Authors
Kumar, S., West, R., & Leskovec, J.
Affiliations
  • University of Maryland, College Park (US)
  • Stanford University (US)
Venue
Proceedings of the 25th International Conference on World Wide Web
Published
2016-04-11
Pages
591-602
OpenAlex
W2340254858
Cited by
310
References
38
Citations by year
2026: 3 · 2025: 17 · 2024: 27 · 2023: 28 · 2022: 29 · 2021: 71 · 2020: 35 · 2019: 39 · 2018: 34 · 2017: 23 · 2016: 4
FWCI
105.59
Type
conference paper
Language
en
Open access
closed
Locations
International World Wide Web Conference (WWW) (publishedVersion)
Funders
  • Stanford Data Science Initiative
  • Defense Advanced Research Projects Agency (XDATA SIMPLEX)
  • SAP
  • Volkswagen
  • Boeing
  • Army Research Office (MURI W911NF11103 W911NF1410358 W911NF09102)
  • Yahoo
  • Wikimedia Research Fellowship
  • National Science Foundation (CNS-1010921 IIS-1149837)
  • Facebook
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Social Sciences › Communication › Wikis in Education and Collaboration
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
Keywords
Wikipedia, disinformation, misinformation, hoax detection, page views, web citations, article structure

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes. https://app.cochat.ai/papers/10.1145/2872427.2883085
The paper
Kumar, S., West, R., & Leskovec, J. (2016). Disinformation on the Web: Impact, Characteristics, and Detection of Wikipedia Hoaxes. Proceedings of the 25th International Conference on World Wide Web. https://doi.org/10.1145/2872427.2883085

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.