The Pulse of News in Social Media: Forecasting Popularity
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
News articles are extremely time sensitive by nature. There is also intense competition among news items to propagate as widely as possible. Hence, the task of predicting the popularity of news items on the social web is both interesting and challenging. Prior research has dealt with predicting eventual online popularity based on early popularity. It is most desirable, however, to predict the popularity of items prior to their release, fostering the possibility of appropriate decision making to modify an article and the manner of its publication. In this paper, we construct a multi-dimensional feature space derived from properties of an article and evaluate the efficacy of these features to serve as predictors of online popularity. We examine both regression and classification algorithms and demonstrate that despite randomness in human behavior, it is possible to predict ranges of popularity on twitter with an overall 84% accuracy. Our study also serves to illustrate the differences between traditionally prominent sources and those immensely popular on the social web.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
John Lu, Z. Q. (2010) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2010.00646_6.x · Cited by 12,390
Libsvm : A library for support vector machines
Ferrari, V. (2008) · Medical Entomology and Zoology · Cited by 10,122
Hayward, G. (1984) · Technovation · doi:10.1016/0166-4972(84)90018-x · Cited by 2,715
Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market
Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006) · Science · doi:10.1126/science.1121066 · Cited by 2,231
The dynamics of viral marketing
Leskovec, J., Adamic, L. A., & Huberman, B. A. (2007) · ACM Transactions on the Web · doi:10.1145/1232722.1232727 · Cited by 2,032
Self-citationMeme-tracking and the dynamics of the news cycle
Leskovec, J., Backstrom, L., & Kleinberg, J. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557077 · Cited by 1,530
Romero, D. M., Meeder, B., & Kleinberg, J. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963503 · Cited by 1,082
Information diffusion through blogspace
Gruhl, D., Guha, R., Liben-Nowell, D., & Tomkins, A. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988739 · Cited by 1,041
Maximizing the spread of influence through a social network
Kempe, D., Kleinberg, J. M., & Tardos, É. (2003) · ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/956755.956769 · Cited by 1,034
Patterns of temporal variation in online media
Yang, J., & Leskovec, J. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935863 · Cited by 986
Predicting the popularity of online content
Szabo, G., & Huberman, B. A. (2010) · Communications of the ACM · doi:10.1145/1787234.1787254 · Cited by 983
Self-citationInformation diffusion through blogspace
Gruhl, D., Liben-Nowell, D., Guha, R., & Tomkins, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1046456.1046462 · Cited by 927
Information contagion: an empirical study of the spread of news on digg and twitter social networks
Lerman, K., & Ghosh, R. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14021 · Cited by 813
Modeling bursts and heavy tails in human dynamics
Vázquez, A., Oliveira, J. G., Dezsö, Z., Goh, K.-I., Kondor, I., & Barabási, A.-L. (2006) · Physical Review E · doi:10.1103/physreve.73.036127 · Cited by 673
A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts
Pang, B., & Lee, L. (2004) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0409058 · Cited by 652
Novelty and collective attention
Wu, F., & Huberman, B. A. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0704916104 · Cited by 608
Self-citationIdentifying the influential bloggers in a community
Agarwal, N., Liu, H., Tang, L., & Yu, P. S. (2008) · Proceedings of the international conference on Web search and web data mining - WSDM '08 · doi:10.1145/1341531.1341559 · Cited by 511
Using a model of social dynamics to predict popularity of news
Lerman, K., & Hogg, T. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772754 · Cited by 295
“Gesundheit! Modeling Contagion through Facebook News Feed.”
Sun, E., Rosenn, I., Marlow, C., & Lento, T. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13947 · Cited by 218
Cascading Behavior in Large Blog Graphs
Leskovec, J., McGlohon, M., Faloutsos, C., Glance, N., & Hurst, M. F. (2007) · arXiv (Cornell University) · doi:10.48550/arxiv.0704.2803 · Cited by 147
Experimental study of inequality and unpredictability in an artificial cultural market
Salganik, M. J., Dodds, P. S., & Watts, D. J. (2022) · Handbook of Sociological Science · doi:10.4337/9781789909432.00032 · Cited by 139
Predicting the popularity of online articles based on user comments
Tatar, A., Leguay, J., Antoniadis, P., Limbourg, A., de Amorim, M. D., & Fdida, S. (2011) · International Conference on Web Intelligence, Mining and Semantics · doi:10.1145/1988688.1988766 · Cited by 132
Predicting the Popularity of Online ContentPreprint
Szabo, G., & Huberman, B. A. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1295610 · Cited by 131
Self-citationDigging Digg: Comment Mining, Popularity Prediction, and Social Network Analysis
Jamali, S., & Rangwala, H. (2009) · International Conference on Web Information Systems and Mining (WISM) · doi:10.1109/wism.2009.15 · Cited by 127
Information resonance on Twitter: watching Iran
Zhou, Z., Bandari, R., Kong, J. S., Qian, H., & Roychowdhury, V. (2010) · doi:10.1145/1964858.1964875 · Cited by 123
Self-citationAn Approach to Model and Predict the Popularity of Online Contents with Explanatory Factors
Lee, J. G., Moon, S. B., & Salamatian, K. (2010) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat.2010.209 · Cited by 109
Sequential Influence Models in Social Networks
Cosley, D., Huttenlocher, D. P., Kleinberg, J. M., Lan, X., & Suri, S. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14027 · Cited by 93
Toward Predicting Popularity of Social Marketing Messages
Yu, B., Chen, M., & Kwok, L. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-19656-0_44 · Cited by 45
Cited by
Kümpel, A. S., Karnowski, V., & Keyling, T. (2015) · Social Media + Society · doi:10.1177/2056305115610141 · Cited by 449
Lalmas, M., O’Brien, H., & Yom-Tov, E. (2015) · Synthesis Lectures on Information Concepts, Retrieval, and Services · doi:10.1007/978-3-031-02289-0 · Cited by 192
Optimizing the recency-relevance-diversity trade-offs in non-personalized news recommendations
Chakraborty, A., Ghosh, S., Ganguly, N., & Gummadi, K. P. (2019) · Information Retrieval Journal · doi:10.1007/s10791-019-09351-2 · Cited by 24
Metadata
- Authors
- Bandari, R., Asur, S., & Huberman, B.
- Venue
- Proceedings of the International AAAI Conference on Web and Social Media
- Published
- 2021-08-03
- Volume
- 6
- Issue
- 1
- Pages
- 26-33
- ISSN
- 2162-3449 (ISSN-L)
- 2334-0770
- OpenAlex
- W2097343308
- Cited by
- 296
- References
- 31
- FWCI
- 21.36
- Type
- conference paper
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.