The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Sensing Trending Topics in Twitter
Open accessAbstract
Online social and news media generate rich and timely information about real-world events of all kinds. However, the huge amount of data available, along with the breadth of the user base, requires a substantial effort of information filtering to successfully drill down to relevant topics and events. Trending topic detection is therefore a fundamental building block to monitor and summarize information originating from social sources. There are a wide variety of methods and variables and they greatly affect the quality of results. We compare six topic detection methods on three Twitter datasets related to major events, which differ in their time scale and topic churn rate. We observe how the nature of the event considered, the volume of activity over time, the sampling procedure and the pre-processing of the data all greatly affect the quality of detected topics, which also depends on the type of detection method used. We find that standard natural language processing techniques can perform well for social streams on very focused topics, but novel techniques designed to mine the temporal distribution of concepts are needed to handle more heterogeneous streams containing multiple stories evolving in parallel. One of the novel topic detection methods we propose, based on -grams cooccurrence and topic ranking, consistently achieves the best performance across all these conditions, thus being more reliable than other state-of-the-art techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
Introduction to Modern Information Retrieval
Salton, G., & McGill, M. J. (1983) · Virtual Defense Library (Ministerio de Defensa) · Cited by 11,392
Introduction to modern information retrieval
Dillon, M. (1983) · Information Processing & Management · doi:10.1016/0306-4573(83)90062-6 · Cited by 5,909
Earthquake shakes Twitter users: real-time event detection by social sensors
Sakaki, T., Okazaki, M., & Matsuo, Y. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772777 · Cited by 3,640
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.993 · Cited by 3,024
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Blei, D. M., & Lafferty, J. D. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143859 · Cited by 2,386
Hierarchical Dirichlet Processes
Teh, Y. W., Jordan, M. I., Beal, M. J., & Blei, D. M. (2006) · Journal of the American Statistical Association · doi:10.1198/016214506000000302 · Cited by 2,120
Meme-tracking and the dynamics of the news cycle
Leskovec, J., Backstrom, L., & Kleinberg, J. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557077 · Cited by 1,530
Structure and evolution of online social networks
Kumar, R., Novak, J., & Tomkins, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150476 · Cited by 1,084
Readings in information retrieval
Jones, K. S., & Willett, P. (1997) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 1,069
A Survey of Recent Advances in Hierarchical Clustering Algorithms
Murtagh, F. (1983) · The Computer Journal · doi:10.1093/comjnl/26.4.354 · Cited by 1,058
Patterns of temporal variation in online media
Yang, J., & Leskovec, J. (2011) · Proceedings of the fourth ACM international conference on Web search and data mining · doi:10.1145/1935826.1935863 · Cited by 986
SCAN: a structural clustering algorithm for networks
Xu, X., Yuruk, N., Feng, Z., & Schweiger, T. A. J. (2007) · Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1281192.1281280 · Cited by 842
TwitterMonitor: trend detection over the twitter stream
Mathioudakis, M., & Koudas, N. (2010) · Proceedings of the 2010 ACM SIGMOD International Conference on Management of data · doi:10.1145/1807167.1807306 · Cited by 813
A measurement-driven analysis of information propagation in the flickr social network
Cha, M., Mislove, A., & Gummadi, K. P. (2009) · Proceedings of the 18th international conference on World wide web · doi:10.1145/1526709.1526806 · Cited by 768
Microscopic evolution of social networks
Leskovec, J., Backstrom, L., Kumar, R., & Tomkins, A. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401948 · Cited by 728
Weng, J., & Lee, B.-S. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14102 · Cited by 714
Topic detection and tracking: event-based information organization
Allan, J. (2002) · Cited by 682
Beyond Trending Topics: Real-World Event Identification on Twitter
Becker, H., Naaman, M., & Gravano, L. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14146 · Cited by 680
Sankaranarayanan, J., Samet, H., Teitler, B. E., Lieberman, M. D., & Sperling, J. (2009) · Proceedings of the 17th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems · doi:10.1145/1653771.1653781 · Cited by 673
Predicting the Political Alignment of Twitter Users
Conover, M. D., Goncalves, B., Ratkiewicz, J., Flammini, A., & Menczer, F. (2011) · 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing · doi:10.1109/passat/socialcom.2011.34 · Cited by 588
Detecting and Tracking Political Abuse in Social Media
Ratkiewicz, J., Conover, M., Meiss, M., Goncalves, B., Flammini, A., & Menczer, F. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14127 · Cited by 579
Streaming First Story Detection with application to Twitter
Petrović, S., Osborne, M., & Lavrenko, V. P. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 573
Overview of multidatabase transaction management
Breitbart, Y., Garcia-Molina, H., & Silberschatz, A. (1992) · The VLDB Journal · doi:10.1007/bf01231700 · Cited by 565
Emerging topic detection on Twitter based on temporal and social terms evaluation
Cataldi, M., Di Caro, L., & Schifanella, C. (2010) · Proceedings of the Tenth International Workshop on Multimedia Data Mining · doi:10.1145/1814245.1814249 · Cited by 537
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation
Teh, Y. W., Newman, D., & Welling, M. (2007) · doi:10.21236/ada629956 · Cited by 490
Pfp: parallel fp-growth for query recommendation
Li, H., Wang, Y., Zhang, D., Zhang, M., & Chang, E. Y. (2008) · Proceedings of the 2008 ACM conference on Recommender systems · doi:10.1145/1454008.1454027 · Cited by 444
Friendship prediction and homophily in social media
Aiello, L. M., Barrat, A., Schifanella, R., Cattuto, C., Markines, B., & Menczer, F. (2012) · ACM Transactions on the Web · doi:10.1145/2180861.2180866 · Cited by 441
Self-citationThe socialbot network: when bots socialize for fame and money
Boshmaf, Y., Muslukhov, I., Beznosov, K., & Ripeanu, M. (2011) · Proceedings of the 27th Annual Computer Security Applications Conference · doi:10.1145/2076732.2076746 · Cited by 436
Dynamical classes of collective attention in twitter
Lehmann, J., Gonçalves, B., Ramasco, J. J., & Cattuto, C. (2012) · Proceedings of the 21st international conference on World Wide Web · doi:10.1145/2187836.2187871 · Cited by 380
TweetMotif: Exploratory Search and Topic Summarization for Twitter
O'Connor, B., Krieger, M., & Ahn, D. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14008 · Cited by 364
Event Detection and Tracking in Social Streams
Sayyadi, H., Hurst, M., & Maykov, A. (2009) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v3i1.13970 · Cited by 295
Breaking News Detection and Tracking in Twitter
Phuvipadawat, S., & Murata, T. (2010) · 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology · doi:10.1109/wi-iat.2010.205 · Cited by 275
Cohen, S., Hamilton, J. T., & Turner, F. (2011) · Communications of the ACM · doi:10.1145/2001269.2001288 · Cited by 207
Tracking "gross community happiness" from tweets
Quercia, D., Ellis, J., Capra, L., & Crowcroft, J. (2012) · Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work · doi:10.1145/2145204.2145347 · Cited by 173
People Are Strange When You're a Stranger: Impact and Influence of Bots on Social Networks
Aiello, L. M., Deplano, M., Schifanella, R., & Ruffo, G. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i1.14236 · Cited by 120
Self-citationPeaks and persistence: modeling the shape of microblog conversations
Shamma, D. A., Kennedy, L. S., & Churchill, E. F. (2011) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1958824.1958878 · Cited by 117
Goethals, B. (2009) · Springer eBooks · doi:10.1007/978-0-387-09823-4_16 · Cited by 72
The Dynamics of Content Popularity in Social Media
Papadopoulos, S., Vakali, A. I., & Kompatsiaris, I. Y. (2010) · International Journal of Data Warehousing and Mining · doi:10.4018/jdwm.2010090802 · Cited by 8
Self-citation
Cited by
Real-Time Detection of Traffic From Twitter Stream Analysis
D'Andrea, E., Ducange, P., Lazzerini, B., & Marcelloni, F. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2404431 · Cited by 330
Deep learning for misinformation detection on online social networks: a survey and new perspectives
Islam, M. R., Liu, S., Wang, X., & Xu, G. (2020) · Social Network Analysis and Mining · doi:10.1007/s13278-020-00696-x · Cited by 289
Pearce, W., Holmberg, K., Hellsten, I., & Nerlich, B. (2014) · PLoS ONE · doi:10.1371/journal.pone.0094785 · Cited by 285
True or False: Studying the Work Practices of Professional Fact-Checkers
Micallef, N., Armacost, V., Memon, N., & Patil, S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512974 · Cited by 70
Metadata
- Authors
- Aiello, L. M., Petkos, G., Martin, C., Corney, D., Papadopoulos, S., Skraba, R., Goker, A., Kompatsiaris, I., & Jaimes, A.
- Venue
- IEEE Transactions on Multimedia
- Published
- 2013-10
- Volume
- 15
- Issue
- 6
- Pages
- 1268-1282
- ISSN
- 1520-9210 (ISSN-L)
- 1941-0077
- OpenAlex
- W1982029265
- Cited by
- 431
- References
- 40
- FWCI
- 42.70
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.