Classifying the Political Leaning of News Articles and Users from User Votes
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Social news aggregator services generate readers’ subjective reactions to news opinion articles. Can we use those as a resource to classify articles as liberal or conservative, even without knowing the self-identified political leaning of most users? We applied three semi-supervised learning methods that propagate classifications of political news articles and users as conservative or liberal, based on the assumption that liberal users will vote for liberal articles more often, and similarly for conservative users and articles. Starting from a few labeled articles and users, the algorithms propagate political leaning labels to the entire graph. In cross-validation, the best algorithm achieved 99.6% accuracy on held-out users and 96.3% accuracy on held-out articles. Adding social data such as users’ friendship or text features such as cosine similarity did not improve accuracy. The propagation algorithms, using the subjective liking data from users, also performed better than an SVM based text classifier, which achieved 92.0% accuracy on articles.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The political blogosphere and the 2004 U.S. election: divided they blog
Adamic, L. A., & Glance, N. (2005) · Proceedings of the 3rd international workshop on Link discovery · doi:10.1145/1134271.1134277 · Cited by 2,619
Extracting Policy Positions from Political Texts Using Words as Data
LAVER, M., BENOIT, K., & GARRY, J. (2003) · American Political Science Review · doi:10.1017/s0003055403000698 · Cited by 1,377 · cited 1×
“One line of work used word frequencies, Bayesian statistical models, and topic models (Laver et al 2003, Martin and Vanberg 2008, Lin 2006, Lin et al 2008, Monroe et al 2008, Slaping and Proksch 2008).”
MethodA Scaling Model for Estimating Time‐Series Party Positions from Texts
Slapin, J. B., & Proksch, S. (2008) · American Journal of Political Science · doi:10.1111/j.1540-5907.2008.00338.x · Cited by 684
Monroe, B. L., Colaresi, M. P., & Quinn, K. M. (2008) · Political Analysis · doi:10.1093/pan/mpn018 · Cited by 542 · cited 1×
“One line of work used word frequencies, Bayesian statistical models, and topic models (Laver et al 2003, Martin and Vanberg 2008, Lin 2006, Lin et al 2008, Monroe et al 2008, Slaping and Proksch 2008).”
MethodPark, S., Ko, M., Kim, J., Liu, Y., & Song, J. (2011) · Proceedings of the ACM 2011 conference on Computer supported cooperative work · doi:10.1145/1958824.1958842 · Cited by 88
Cited by
The Consequences of the Internet for Politics
Farrell, H. (2012) · Annual Review of Political Science · doi:10.1146/annurev-polisci-030810-110815 · Cited by 387
Fair and Balanced? Quantifying Media Bias through Crowdsourced Content Analysis
Budak, C., Goel, S., & Rao, J. M. (2016) · Public Opinion Quarterly · doi:10.1093/poq/nfw007 · Cited by 336
“This approach has produced sensible ideological orderings of outlets (Gentzkow and Shapiro, 2011; Zhou et al., 2011).”
BackgroundAuditing Partisan Audience Bias within Google Search
Robertson, R. E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., & Wilson, C. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274417 · Cited by 209
Quantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media
Kulshrestha, J., Eslami, M., Messias, J., Zafar, M. B., Ghosh, S., Gummadi, K. P., & Karahalios, K. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998321 · Cited by 148
The Web of False Information: Rumors, Fake News, Hoaxes, Clickbait, and Various Other Shenanigans
Zannettou, S., Sirivianos, M., Blackburn, J., & Kourtellis, N. (2019) · Journal of Data and Information Quality · doi:10.1145/3309699 · Cited by 86
“t-related and sentiment-related features) from a large corpus of tweets they demonstrate that they can distinguish promotedcampaigns with an AUC score close to 95% in a timely manner. Biased.Zhouetal.[197]studyDigg,anewsaggregatorsite,andaimtoclassifyusersandarticlestoeitherliberalorconservative. To achievethis, they…”
Background
Metadata
- Authors
- Zhou, D. X., Resnick, P., & Mei, Q.
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2021-08-03
- Volume
- 5
- Issue
- 1
- Pages
- 417-424
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W2217796615
- Cited by
- 84
- References
- 5
- FWCI
- 1.85
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Classifying the Political Leaning of News Articles and Users from User Votes. https://app.cochat.ai/papers/10.1609/icwsm.v5i1.14108
- The paper
- Zhou, D. X., Resnick, P., & Mei, Q. (2021). Classifying the Political Leaning of News Articles and Users from User Votes. Proceedings of the International AAAI Conference on Web and Social Media. https://doi.org/10.1609/icwsm.v5i1.14108
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.