Validation of Twitter opinion trends with national polling aggregates: Hillary Clinton vs Donald Trump
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Measuring and forecasting opinion trends from real-time social media is a long-standing goal of big-data analytics. Despite the large amount of work addressing this question, there has been no clear validation of online social media opinion trend with traditional surveys. Here we develop a method to infer the opinion of Twitter users by using a combination of statistical physics of complex networks and machine learning based on hashtags co-occurrence to build an in-domain training set of the order of a million tweets. We validate our method in the context of 2016 US Presidential Election by comparing the Twitter opinion trend with the New York Times National Polling Average, representing an aggregate of hundreds of independent traditional polls. The Twitter opinion trend follows the aggregated NYT polls with remarkable accuracy. We investigate the dynamics of the social network formed by the interactions among millions of Twitter supporters and infer the support of each user to the presidential candidates. Our analytics unleash the power of Twitter to uncover social trends from elections, brands to political movements, and at a fraction of the cost of traditional surveys.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Finding and evaluating community structure in networks
Newman, M. E. J., & Girvan, M. (2004) · Physical Review E · doi:10.1103/physreve.69.026113 · Cited by 13,931
The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
Tausczik, Y. R., & Pennebaker, J. W. (2010) · Journal of Language and Social Psychology · doi:10.1177/0261927x09351676 · Cited by 5,774
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Bollobás, B. (2001) · doi:10.1017/cbo9780511814068 · Cited by 2,639
Online Human-Bot Interactions: Detection, Estimation, and Characterization
Varol, O., Ferrara, E., Davis, C., Menczer, F., & Flammini, A. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14871 · Cited by 981
Is the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose
Morstatter, F., Pfeffer, J., Liu, H., & Carley, K. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14401 · Cited by 863
The Effects of Twitter Sentiment on Stock Price Returns
Ranco, G., Aleksovski, D., Caldarelli, G., Grčar, M., & Mozetič, I. (2015) · PLoS ONE · doi:10.1371/journal.pone.0138441 · Cited by 395
Partisan asymmetries in online political activity
Conover, M. D., Gonçalves, B., Flammini, A., & Menczer, F. (2012) · EPJ Data Science · doi:10.1140/epjds6 · Cited by 234 · cited 1×
“These findings confirm previous studies suggesting that right-wing leaning Twitter users exhibit greater levels of activity and more tightly interconnected social structure [18, 50].”
BackgroundPredicting Elections for Multiple Countries Using Twitter and Polls
Tsakalidis, A., Papadopoulos, S., Cristea, A. I., & Kompatsiaris, Y. (2015) · IEEE Intelligent Systems · doi:10.1109/mis.2015.17 · Cited by 79 · cited 1×
“Indeed, there has been many contributions in journals [11, 14, 20, 21, 23, 24, 34, 35, 37, 38] and, in social computing conferences [10, 12, 13, 15–19, 22, 25–27, 47] dealing with public opinion and political processes in Twitter (see also the Science Issue 6324 (February 03, 2017) on “Prediction”…”
BackgroundTwo 1%s don't make a whole: comparing simultaneous samples from twitter's streaming api
Joseph, K., Landwehr, P. M., & Carley, K. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-05579-4_10 · Cited by 69
Cited by
Influence of fake news in Twitter during the 2016 US presidential election
Bovet, A., & Makse, H. A. (2019) · Nature Communications · doi:10.1038/s41467-018-07761-2 · Cited by 701
Self-citationFlamino, J., Galeazzi, A., Feldman, S., Macy, M. W., Cross, B., Zhou, Z., Serafino, M., Bovet, A., Makse, H. A., & Szymanski, B. K. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01550-8 · Cited by 113
Self-citationUsing sentiment analysis to predict opinion inversion in Tweets of political communication
Matalon, Y., Magdaci, O., Almozlino, A., & Yamin, D. (2021) · Scientific Reports · doi:10.1038/s41598-021-86510-w · Cited by 64
Natural Language Processing in Marketing
Hartmann, J., & Netzer, O. (2023) · Artificial Intelligence in Marketing · doi:10.1108/s1548-643520230000020011 · Cited by 38
Metadata
- Authors
- Bovet, A., Morone, F., & Makse, H. A.
- Venue
- Scientific Reports
- Published
- 2018-06-06
- Volume
- 8
- Issue
- 1
- Pages
- 8673-8673
- ISSN
- 2045-2322 (ISSN-L)
- OpenAlex
- W2950859079
- Cited by
- 126
- References
- 10
- FWCI
- 8.91
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Validation of Twitter opinion trends with national polling aggregates: Hillary Clinton vs Donald Trump. https://app.cochat.ai/papers/10.1038/s41598-018-26951-y
- The paper
- Bovet, A., Morone, F., & Makse, H. A. (2018). Validation of Twitter opinion trends with national polling aggregates: Hillary Clinton vs Donald Trump. Scientific Reports. https://doi.org/10.1038/s41598-018-26951-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.