Predicting and Interpolating State‐Level Polls Using Twitter Textual Data
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Spatially or temporally dense polling remains both difficult and expensive using existing survey methods. In response, there have been increasing efforts to approximate various survey measures using social media, but most of these approaches remain methodologically flawed. To remedy these flaws, this article combines 1,200 state‐level polls during the 2012 presidential campaign with over 100 million state‐located political tweets; models the polls as a function of the Twitter text using a new linear regularization feature‐selection method; and shows via out‐of‐sample testing that when properly modeled, the Twitter‐based measures track and to some degree predict opinion polls, and can be extended to unpolled states and potentially substate regions and subday timescales. An examination of the most predictive textual features reveals the topics and events associated with opinion shifts, sheds light on more general theories of partisan difference in attention and information processing, and may be of use for real‐time campaign strategy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523 · cited 1×
“2012), but they are generally plagued by small N, ad hoc parameter settings, and presumably high selection bias (Lazer et al. 2014) [S, B, T, O].”
BackgroundPredicting the future with social media
Asur, S., & Huberman, B. A. (2010) · 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology · doi:10.1109/wi-iat.2010.63 · Cited by 2,081
Bayesian Multilevel Estimation with Poststratification: State-Level Estimates from National Polls
Park, D. K., Gelman, A., & Bafumi, J. (2004) · Political Analysis · doi:10.1093/pan/mph024 · Cited by 480
Partisan asymmetries in online political activity
Conover, M. D., Gonçalves, B., Flammini, A., & Menczer, F. (2012) · EPJ Data Science · doi:10.1140/epjds6 · Cited by 234 · cited 1×
“be more cohesive and retweet each other more often than those on the left (Conover et al. 2012; Hoang et al. 2013), which may in turn serve to focus that community on a few more cohesive national political issues.”
Background
Cited by
Fake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
How the news media activate public expression and influence national agendas
King, G., Schneer, B., & White, A. (2017) · Science · doi:10.1126/science.aao1100 · Cited by 333
Integrating Survey Data and Digital Trace Data: Key Issues in Developing an Emerging Field
Stier, S., Breuer, J., Siegers, P., & Thorson, K. (2020) · Social Science Computer Review · doi:10.1177/0894439319843669 · Cited by 312
Data ex Machina: Introduction to Big Data
Lazer, D., & Radford, J. (2017) · Annual Review of Sociology · doi:10.1146/annurev-soc-060116-053457 · Cited by 303
Large-Scale Computerized Text Analysis in Political Science: Opportunities and Challenges
Wilkerson, J., & Casas, A. (2017) · Annual Review of Political Science · doi:10.1146/annurev-polisci-052615-025542 · Cited by 300
Metadata
- Authors
- Beauchamp, N.
- Venue
- American Journal of Political Science
- Publisher
- Wiley
- Published
- 2016-09-13
- Volume
- 61
- Issue
- 2
- Pages
- 490-503
- ISSN
- 0092-5853 (ISSN-L)
- 1540-5907
- OpenAlex
- W2145773944
- Cited by
- 132
- References
- 9
- FWCI
- 10.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.