The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
A Stylometric Inquiry into Hyperpartisan and Fake News
Open accessAbstract
We report on a comparative style analysis of hyperpartisan (extremely one-sided) news and fake news.A corpus of 1,627 articles from 9 political publishers, three each from the mainstream, the hyperpartisan left, and the hyperpartisan right, have been fact-checked by professional journalists at BuzzFeed: 97% of the 299 fake news articles identified are also hyperpartisan.We show how a style analysis can distinguish hyperpartisan news from the mainstream (F 1 = 0.78), and satire from both (F 1 = 0.81).But stylometry is no silver bullet as style-based fake news detection does not work (F 1 = 0.46).We further reveal that left-wing and right-wing news share significantly more stylistic similarities than either does with the mainstream.This result is robust: it has been confirmed by three different modeling approaches, one of which employs Unmasking in a novel way.Applications of our results include partisanship detection and pre-screening for semi-automatic fake news detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detection
Wang, W. Y. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2067 · Cited by 1,516
The General Inquirer: A Computer Approach to Content Analysis
Green, B. F., Stone, P. J., Dunphy, D. C., Smith, M. S., & Ogilvie, D. M. (1967) · American Educational Research Journal · doi:10.2307/1161774 · Cited by 1,013
Open information extraction from the web
Etzioni, O., Banko, M., Soderland, S., & Weld, D. S. (2008) · Communications of the ACM · doi:10.1145/1409360.1409378 · Cited by 1,012
Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking
Rashkin, H., Choi, E., Jang, J. Y., Volkova, S., & Choi, Y. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1317 · Cited by 870
Prominent Features of Rumor Propagation in Online Social Media
Kwon, S., Cha, M., Jung, K., Chen, W., & Wang, Y. (2013) · 2013 IEEE 13th International Conference on Data Mining · doi:10.1109/icdm.2013.61 · Cited by 859
Limiting the spread of misinformation in social networks
Budak, C., Agrawal, D., & El Abbadi, A. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963499 · Cited by 807
Horne, B., & Adali, S. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14976 · Cited by 688
Detect Rumors in Microblog Posts Using Propagation Structure via Kernel Learning
Ma, J., Gao, W., & Wong, K.-F. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1066 · Cited by 637
Fake News or Truth? Using Satirical Cues to Detect Potentially Misleading News
Rubin, V., Conroy, N., Chen, Y., & Cornwell, S. (2016) · Proceedings of the Second Workshop on Computational Approaches to Deception Detection · doi:10.18653/v1/w16-0802 · Cited by 584
Automatic Detection of Fake News
Pérez‐Rosas, V., Kleinberg, B., Lefevre, A., & Mihalcea, R. F. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.07104 · Cited by 502
Computational Fact Checking from Knowledge Networks
Ciampaglia, G. L., Shiralkar, P., Rocha, L. M., Bollen, J., Menczer, F., & Flammini, A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0128193 · Cited by 486
Spread of (mis)information in social networks
Acemoglu, D., Ozdaglar, A., & ParandehGheibi, A. (2010) · Games and Economic Behavior · doi:10.1016/j.geb.2010.01.005 · Cited by 444
Volkova, S., Shaffer, K., Jang, J. Y., & Hodas, N. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p17-2102 · Cited by 381
Detecting Hoaxes, Frauds, and Deception in Writing Style Online
Afroz, S., Brennan, M., & Greenstadt, R. (2012) · 2012 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2012.34 · Cited by 331
SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours
Derczynski, L., Bontcheva, K., Liakata, M., Procter, R., Wong Sak Hoi, G., & Zubiaga, A. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2006 · Cited by 323
Measuring Differentiability: Unmasking Pseudonymous Authors
Koppel, M., Schler, J., & Bonchek-Dokow, E. (2007) · Journal of Machine Learning Research · doi:10.5555/1314498.1314541 · Cited by 264
Collective attention in the age of (mis)information
Mocanu, D., Rossi, L., Zhang, Q., Karsai, M., & Quattrociocchi, W. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.024 · Cited by 242
Containment of misinformation spread in online social networks
Nguyen, N. P., Yan, G., Thai, M. T., & Eidenbenz, S. (2012) · Proceedings of the 4th Annual ACM Web Science Conference · doi:10.1145/2380718.2380746 · Cited by 239
Towards News Verification: Deception Detection Methods for News Discourse
Rubin, V. L., Conroy, N. J., & Chen, Y. (2015) · Scholarship@Western (Western University) · doi:10.13140/2.1.4822.8166 · Cited by 209
News in an online world: The need for an “automatic crap detector”
Chen, Y., Conroy, N. K., & Rubin, V. L. (2015) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.2015.145052010081 · Cited by 193
Fake News Detection Through Multi-Perspective Speaker Profiles
Long, Y., Lu, Q., Xiang, R., Li, M., & Huang, C. (2017) · Open Access at Essex (University of Essex) · Cited by 187
Bourgonje, P., Schneider, J. M., & Rehm, G. (2017) · doi:10.18653/v1/w17-4215 · Cited by 179
Fact-checking Effect on Viral Hoaxes: A Model of Misinformation Spread in Social Networks
Tambuscio, M., Ruffo, G., Flammini, A., & Menczer, F. (2015) · Proceedings of the 24th International Conference on World Wide Web · doi:10.1145/2740908.2742572 · Cited by 158
Toward computational fact-checking
Wu, Y., Agarwal, P. K., Li, C., Yang, J., & Yu, C. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2732286.2732295 · Cited by 137
Vandalism Detection in Wikidata
Heindorf, S., Potthast, M., Stein, B., & Engels, G. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983740 · Cited by 121
Self-citationSpread of (Mis)Information in Social NetworksPreprint
Acemoğlu, D., Ozdaglar, A., & ParandehGheibi, A. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1401648 · Cited by 94
Fact Checking in Heterogeneous Information Networks
Shi, B., & Weninger, T. (2016) · International World Wide Web Conference (WWW) · doi:10.1145/2872518.2889354 · Cited by 91
Style-based Text Categorization: What Newspaper Am I Reading?
Avneri, G. (1998) · Cited by 85
Satirical News Detection and Analysis using Attention Mechanism and Linguistic Features
Yang, F., Mukherjee, A., & Dragut, E. C. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1211 · Cited by 83
Web-based statistical fact checking of textual documents
Magdy, A., & Wanas, N. (2010) · Proceedings of the 2nd international workshop on Search and mining user-generated contents · doi:10.1145/1871985.1872002 · Cited by 59
Credibility in Information Retrieval
Ginsca, A., Popescu, A., & Lupu, M. (2015) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000046 · Cited by 58
Identifying Real or Fake Articles: Towards better Language Modeling
Badaskar, S., Agarwal, S., & Arora, S. (2008) · Cited by 29
Credibility in Information Retrieval
Ginsca, A., Popescu, A., & Lupu, M. (2015) · now publishers, Inc. eBooks · doi:10.1561/9781680830873 · Cited by 18
Cited by
Fake News Detection on Social Media: A Data Mining Perspective
Shu, K., Sliva, A., Wang, S., Tang, J., & Liu, H. (2017) · ACM SIGKDD Explorations Newsletter · doi:10.1145/3137597.3137600 · Cited by 3,304
A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities
Zhou, X., & Zafarani, R. (2021) · ACM Computing Surveys · doi:10.1145/3395046 · Cited by 1,184
Fake news, disinformation and misinformation in social media: a review
Aïmeur, E., Amri, S., & Brassard, G. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01028-5 · Cited by 772
Talwar, S., Dhir, A., Kaur, P., Zafar, N., & Alrasheedy, M. (2019) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2019.05.026 · Cited by 550
SpotFake: A Multi-modal Framework for Fake News Detection
Singhal, S., Shah, R. R., Chakraborty, T., Kumaraguru, P., & Satoh, S. (2019) · 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM) · doi:10.1109/bigmm.2019.00-44 · Cited by 534
Metadata
- Authors
- Potthast, M., Kiesel, J., Reinartz, K., Bevendorff, J., & Stein, B.
- Venue
- Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Published
- 2018
- Pages
- 231-240
- OpenAlex
- W2593408211
- Cited by
- 686
- References
- 33
- FWCI
- 236.16
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.