The DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
A Meta-Analysis of State-of-the-Art Electoral Prediction From Twitter Data
Open accessAbstract
Electoral prediction from Twitter data is an appealing research topic. It seems relatively straightforward and the prevailing view is overly optimistic. This is problematic because while simple approaches are assumed to be good enough, core problems are not addressed. Thus, this article aims to (1) provide a balanced and critical review of the state of the art; (2) cast light on the presume predictive power of Twitter data; and (3) propose some considerations to push forward the field. Hence, a scheme to characterize Twitter prediction methods is proposed. It covers every aspect from data collection to performance evaluation, through data processing and vote inference. Using that scheme, prior research is analyzed and organized to explain the main approaches taken up to date but also their weaknesses. This is the first meta-analysis of the whole body of research regarding electoral prediction from Twitter data. It reveals that its presumed predictive power regarding electoral prediction has been somewhat exaggerated: Social media may provide a glimpse on electoral outcomes but, up to now, research has not provided strong evidence to support it can currently replace traditional polls. Nevertheless, there are some reasons for optimism and, hence, further work on this topic is required, along with tighter integration with traditional electoral forecasting research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Opinion Mining and Sentiment Analysis
Pang, B., & Lee, L. (2008) · now publishers, Inc. eBooks · doi:10.1561/9781601981516 · Cited by 6,720
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Twitter mood predicts the stock market
Bollen, J., Mao, H., & Zeng, X. (2011) · Journal of Computational Science · doi:10.1016/j.jocs.2010.12.007 · Cited by 5,206
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Recognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,260
Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
Information credibility on twitter
Castillo, C., Mendoza, M., & Poblete, B. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963500 · Cited by 2,593
Predicting the Present with Google Trends
CHOI, H., & VARIAN, H. (2012) · Economic Record · doi:10.1111/j.1475-4932.2012.00809.x · Cited by 2,354
Predicting the future with social media
Asur, S., & Huberman, B. A. (2010) · 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology · doi:10.1109/wi-iat.2010.63 · Cited by 2,081
From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
O'Connor, B., Balasubramanyan, R., Routledge, B., & Smith, N. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14031 · Cited by 1,923
Political Polarization on Twitter
Conover, M., Ratkiewicz, J., Francisco, M., Goncalves, B., Flammini, A., & Menczer, F. (2011) · Zenodo · doi:10.5281/zenodo.4589064 · Cited by 1,254
Is the Sample Good Enough? Comparing Data from Twitter's Streaming API with Twitter's Firehose
Morstatter, F., Pfeffer, J., Liu, H., & Carley, K. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14401 · Cited by 863
Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
A Method of Automated Nonparametric Content Analysis for Social Science
Hopkins, D. J., & King, G. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00428.x · Cited by 765
Understanding the Demographics of Twitter Users
Mislove, A., Lehmann, S., Ahn, Y.-Y., Onnela, J.-P., & Rosenquist, J. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14168 · Cited by 759
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2016) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_907-1 · Cited by 614
Predicting the Political Alignment of Twitter Users
Conover, M. D., Goncalves, B., Ratkiewicz, J., Flammini, A., & Menczer, F. (2011) · 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing · doi:10.1109/passat/socialcom.2011.34 · Cited by 588
Detecting and Tracking Political Abuse in Social Media
Ratkiewicz, J., Conover, M., Meiss, M., Goncalves, B., Flammini, A., & Menczer, F. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14127 · Cited by 579
A Machine Learning Approach to Twitter User Classification
Pennacchiotti, M., & Popescu, A.-M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14139 · Cited by 548
Ceron, A., Curini, L., Iacus, S. M., & Porro, G. (2014) · New Media & Society · doi:10.1177/1461444813480466 · Cited by 510
Tweets from Justin Bieber's heart: the dynamics of the location field in user profiles
Hecht, B., Hong, L., Suh, B., & Chi, E. H. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1978976 · Cited by 465
Predicting Movie Sales from Blogger Sentiment
Mishne, G., & Glance, N. (2006) · UvA-DARE (University of Amsterdam) · Cited by 434
Predicting the Present with Google Trends
Varian, H. R., & Choi, H. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1659302 · Cited by 426
Tweeting is believing?: understanding microblog credibility perceptions
Morris, M. R., Counts, S., Roseway, A., Hoff, A., & Schwarz, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145274 · Cited by 411
The predictive power of online chatter
Gruhl, D., Guha, R., Kumar, R., Novak, J., & Tomkins, A. (2005) · Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining · doi:10.1145/1081870.1081883 · Cited by 407
On Using Twitter to Monitor Political Sentiment and Predict Election Results
Bermingham, A., & Smeaton, A. F. (2011) · Arrow@dit (Dublin Institute of Technology) · Cited by 392
From humor recognition to irony detection: The figurative language of social media
Reyes, A., Rosso, P., & Buscaldi, D. (2012) · Data & Knowledge Engineering · doi:10.1016/j.datak.2012.02.005 · Cited by 377
Tracking the flu pandemic by monitoring the social web
Lampos, V., & Cristianini, N. (2010) · 2010 2nd International Workshop on Cognitive Information Processing · doi:10.1109/cip.2010.5604088 · Cited by 304
How (Not) to Predict Elections
Metaxas, P. T., Mustafaraj, E., & Gayo-Avello, D. (2011) · 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing · doi:10.1109/passat/socialcom.2011.98 · Cited by 282
Self-citationJungherr, A., Jürgens, P., & Schoen, H. (2012) · Social Science Computer Review · doi:10.1177/0894439311404119 · Cited by 267
Predicting the 2011 Dutch Senate Election Results with Twitter
Sang, E. T. K., & Bos, J. (2012) · Cited by 247
Predicting Initial Claims for Unemployment BenefitsPreprint
Choi, H. (2009) · SSRN Electronic Journal · Cited by 243
Where Is This Tweet From? Inferring Home Locations of Twitter Users
Mahmud, J., Nichols, J., & Drews, C. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14299 · Cited by 193
Capturing Global Mood Levels using Blog Posts
Mishne, G., de Rijke, M., Nicolov, N., Salvetti, F., Liberman, M., & Martin, J. H. (2006) · UvA-DARE (University of Amsterdam) · Cited by 177
Don't turn social media into another 'Literary Digest' poll
Gayo-Avello, D. (2011) · Communications of the ACM · doi:10.1145/2001269.2001297 · Cited by 174
Self-citationComputing political preference among twitter followers
Golbeck, J., & Hansen, D. L. (2011) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979106 · Cited by 170
The Party Is Over Here: Structure and Content in the 2010 Election
Livne, A., Simmons, M., Adar, E., & Adamic, L. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14129 · Cited by 160
Tweets and Votes: A Study of the 2011 Singapore General Election
Škorić, M. M., Poor, N. D., Achananuparp, P., Lim, E., & Jiang, J. (2012) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2012.607 · Cited by 151
Vocal Minority Versus Silent Majority: Discovering the Opionions of the Long Tail
Mustafaraj, E., Finn, S., Whitlock, C., & Metaxas, P. (2011) · International Conference on Social Computing · doi:10.1109/passat/socialcom.2011.188 · Cited by 137
From Obscurity to Prominence in Minutes: Political Speech and Real-Time Search
Mustafaraj, E., & Metaxas, P. (2010) · Wellesley College Digital RepositoryWellesley (Wellesley College) · Cited by 135
Lenhart, A., & Fox, S. (2009) · Cited by 126
A user-centric model of voting intention from Social Media
Lampos, V., PreoÅ£iuc-Pietro, D., & Cohn, T. (2013) · UCL Discovery (University College London) · Cited by 96
GOP primary season on twitter: "popular" political sentiment in social media
Mejova, Y., Srinivasan, P., & Boynton, B. (2013) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/2433396.2433463 · Cited by 88
What's in Your Tweets? I Know Who You Supported in the UK 2010 General Election
Boutet, A., Kim, H., & Yoneki, E. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14283 · Cited by 86
Quantifying Political Leaning from Tweets and Retweets
Wong, F. M. F., Tan, C. W., Sen, S., & Chiang, M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v7i1.14422 · Cited by 76
Divided They Tweet: The Network Structure of Political Microbloggers and Discussion Topics
Feller, A., Kuhnert, M., Sprenger, T. O., & Welpe, I. M. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14150 · Cited by 61
Why watching movie tweets won't tell the whole story?
Wong, F. M. F., Sen, S., & Chiang, M. (2012) · doi:10.1145/2342549.2342564 · Cited by 53
Computational Text Analysis for Social Science: Model Assumptions and Complexity
O'Connor, B., Bamman, D., & Smith, N. A. (2011) · KiltHub Repository · doi:10.1184/r1/6473291 · Cited by 51
Where There is a Sea There are Pirates: Response to Jungherr, Jürgens, and Schoen
Tumasjan, A., Sprenger, T. O., Sandner, P., & Welpe, I. M. (2011) · Social Science Computer Review · doi:10.1177/0894439311404123 · Cited by 18
Gaussian Processes for Natural Language Processing
Cohn, T., Preoțiuc-Pietro, D., & Lawrence, N. D. (2014) · doi:10.3115/v1/p14-6001 · Cited by 12
Measuring and quantifying the silent majority on the Internet
Venkataraman, M., Subbalakshmi, K. P., & Chandramouli, R. (2012) · IEEE Sarnoff Symposium · doi:10.1109/sarnof.2012.6222761 · Cited by 8
Research works printed but not linked: 14
- Barberá P., 2012, A new measure of party identification in Twitter. Evidence from Spain
- Boutet A., 2012, Proceedings of the International AAAI Conference on Weblogs and Social Media (ICWSM)
- Campbell , J., 2000, Before the vote: Forecasting American national elections
- Campbell J. E., 2004, Political Science & Politics, 37, 733, 10.1017/S1049096504045020 · doi:10.1017/s1049096504045020
- Conover M. D., 2011, Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media
- Feller A., 2011, Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media
- 10.1111/j.1467-856X.2005.00178.x · doi:10.1111/j.1467-856x.2005.00178.x
- Lewis-Beck M. S., 1992, Forecasting elections
- Mahmud J., 2012, Proceedings of the Sixth International AAAI Conference on Weblogs and Social Media
- Morstatter F., 2013, Proceedings the Seventh International AAAI Conference on Weblogs and Social Media
- O’Connor B., 2011, Proceedings of Second Workshop on Computational Social Science and the Wisdom of Crowds
- Pennacchiotti M., 2011, Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media
- Shi L., 2012, Proceedings of the workshop social network and social media analysis: Methods, models and applications
- Wong F. M. F., 2013, Proceedings of the International AAAI Conference on Weblogs and Social Media (ICWSM)
Cited by
Twitter use in election campaigns: A systematic literature review
Jungherr, A. (2016) · Journal of Information Technology & Politics · doi:10.1080/19331681.2015.1132401 · Cited by 781
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kiciman, E. (2016) · doi:10.2139/ssrn.2886526 · Cited by 763
Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries
Olteanu, A., Castillo, C., Diaz, F., & Kıcıman, E. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00013 · Cited by 763
“, 2015b; Pavalanathan and Eisenstein, 2015), or exit pools or election results (Gayo-Avello et al., 2011; Gayo-Avello, 2012; Gayo-Avello, 2013).”
BackgroundChae, B. (. (2015) · International Journal of Production Economics · doi:10.1016/j.ijpe.2014.12.037 · Cited by 481
Big Data sources and methods for social and economic analyses
Blazquez, D., & Domenech, J. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2017.07.027 · Cited by 343
Metadata
- Authors
- Gayo-Avello, D.
- Venue
- Social Science Computer Review
- Publisher
- SAGE Publications
- Published
- 2013-08-23
- Volume
- 31
- Issue
- 6
- Pages
- 649-679
- ISSN
- 0894-4393 (ISSN-L)
- 1552-8286
- OpenAlex
- W2136645636
- Cited by
- 315
- References
- 54
- FWCI
- 50.25
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.