The DOI matches its Crossref record; 63 of the 65 references it cites were found in a registry or an index.
Bursty and hierarchical structure in streams
Abstract
A fundamental problem in text data mining is to extract meaningful structure from document streams that arrive continuously over time. E-mail and news articles are two natural examples of such streams, each characterized by topics that appear, grow in intensity for a period of time, and then fade away. The published literature in a particular research field can be seen to exhibit similar phenomena over a much longer time scale. Underlying much of the text mining work in this area is the following intuitive premise --- that the appearance of a topic in a document stream is signaled by a "burst of activity," with certain features rising sharply in frequency as the topic emerges.The goal of the present work is to develop a formal approach for modeling such "bursts," in such a way that they can be robustly and efficiently identified, and can provide an organizational framework for analyzing the underlying content. The approach is based on modeling the stream using an infinite-state automaton, in which bursts appear naturally as state transitions; in some ways, it can be viewed as drawing an analogy with models from queueing theory for bursty network traffic. The resulting algorithms are highly efficient, and yield a nested representation of the set of bursts that imposes a hierarchical structure on the overall stream. Experiments with e-mail and research paper archives suggest that the resulting structures have a natural meaning in terms of the content that gave rise to them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
Agrawal, R., & Srikant, R. (2002) · Proceedings of the Eleventh International Conference on Data Engineering · doi:10.1109/icde.1995.380415 · Cited by 5,155
The Analysis of Time Series: An Introduction
Dickey, D. A., & Chatfield, C. (1991) · Technometrics · doi:10.2307/1268794 · Cited by 3,525
Story and Discourse: Narrative Structure in Fiction and Film
Austin, T. R., & Chatman, S. (1979) · The Journal of Aesthetics and Art Criticism · doi:10.2307/430732 · Cited by 2,658
Hand, D. J., Mannila, H., & Smyth, P. (2001) · Cited by 2,581
Attention, intentions, and the structure of discourse
Grosz, B. J., & Sidner, C. L. (1986) · doi:10.5555/12457.12458 · Cited by 2,580
Agents that reduce work and information overload
Maes, P. (1994) · Communications of the ACM · doi:10.1145/176789.176792 · Cited by 2,321
The Analysis of Time Series: An Introduction with R
Chatfield, C., & Xing, H. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9781351259446 · Cited by 1,803
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
Research works printed but not linked: 21
- Agrawal R., 1995, Proc. Intl. Conf. on Data Engineering
- Allan J., 1998, DARPA Broadcast News Transcription and Understanding Workshop
- T. Blanton Ed. White House E-mail New Press 1995. T. Blanton Ed. White House E-mail New Press 1995.
- Chatman S., 1978, Cornell Univ. Press
- Cohen W., 1996, AAAI Spring Symp. Machine Learning and Information Access
- Genette G., 1980, Cornell Univ. Press
- G. Genette Narrative Discourse Revisited English translation (J.E. Lewin) Cornell Univ. Press 1988. G. Genette Narrative Discourse Revisited English translation (J.E. Lewin) Cornell Univ. Press 1988.
- Han J., 1998, Proc. Intl. Conf. Knowledge Discovery and Data Mining
- 10.5555/857190.857680 · doi:10.5555/857190.857680
- Kelly F. P., 1996, Press
- Keogh E., 1997, Intl. Conf. Knowledge Discovery and Data Mining
- Lavrenko V., 2000, KDD-2000 Workshop on Text Mining
- Mannila H., 1995, Intl. Conf. on Knowledge Discovery and Data Mining
- Martin R., 2001, Temporal Data Mining
- Miller N., 1998, IEEE Visualization
- Redmond M., 1998, AAAI Workshop on Case-Based Reasoning
- Rennie J., 2000, KDD Workshop on Text Mining
- Sahami M., 1998, AAAI Workshop on Learning for Text Categorization
- B. Schneier Applied Cryptography Wiley 1996. B. Schneier Applied Cryptography Wiley 1996.
- Segal R., 2000, Proc. Intl. Conf. on Machine Learning
- Wong P., 2000, IEEE Information Visualization
Cited by
Items 1,301–1,342 of 1,342
川中, 翔. (2009) · Institutional Repositories DataBase (IRDB)
Summarizing the Results of a Keyword Search on Tweets with Web-Images
TAMURA, S., TAMURA, K., 北上, 始., & Kitakami, H. (2013) · Institutional Repositories DataBase (IRDB)
Shirahama, K. (2011) · Institutional Repositories DataBase (IRDB)
A Multimodal Distillation Framework for Sound-Based Sleep Quality Assessment
Fukui, K., Lu, H., & Kato, T. (2026) · International Journal of Neural Systems · doi:10.1142/s0129065727500250
Instructors in video-based and online second language learning: a bibliometric analysis (2007–2025)
Zhu, M., & Li, M. (2026) · Discover Education · doi:10.1007/s44217-026-02004-9
Lu, K., & Li, J. (2026) · International Conference on Digital Society and Artificial Intelligence (DSAI) · doi:10.1145/3833541.3833569
Zhang, L., Wang, Z., & Li, K. (2026) · International Conference on Educational Digitalization and Computer Science in the Guangdong-Hong Kong-Macao Greater Bay Area · doi:10.1145/3828183.3828284
Quantum machine learning enhanced civil engineering industry 5.0
Sharma, C., Sood, K., & Sood, S. K. (2026) · The Journal of Supercomputing · doi:10.1007/s11227-026-08878-8
Botelho, E. T., dos Santos, K. F., Barroso, L. L., Cordeiro, M. J. P., de Sousa, L. T., Guimarães, B. A. F., Souza, H. F., de Sousa, A. R., Nunes, G. B., Gonçalves, L. F., et al. (2026) · Animals · doi:10.3390/ani16182957
Social tectonics: Rapid organization of online COVID communities
Koevering, K. V., Hong, Y., & Kleinberg, J. M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0355369
Self-citationRao, H., Guo, F., Tian, J., Zuo, C., & Chen, H. (2026) · Frontiers in Immunology · doi:10.3389/fimmu.2026.1892665
Problematic Pornography Use (PPU) and its Psychopathological Correlates
Luca, I. D. (2025) · University of Hertfordshire Research Archive (University of Hertfordshire)
Predicting Emerging Topics from Outliers: A Prospective Study of Weak Signals in Embedding Space
Zve, E., Bourgne, G., & Ganascia, J.-G. (2026) · doi:10.18653/2026.findings-aacl.94
Identifying and evaluating emerging scientific trends through temporal n-gram analysis
Štimec, G., Novalija, I., Brank, J., Šturm, J., Topal, O., Gheorghe, M., Grobelnik, M., & Roman, D. (2026) · Scientometrics · doi:10.1007/s11192-026-05744-5
Methodological advances and emerging perspectives in geochemical mapping from 2016 to 2025
Wang, J., 熊, 义., Wang, Z., & Xu, Y. (2026) · Journal of Geochemical Exploration · doi:10.1016/j.gexplo.2026.108240
Xu, L., Ren, J., Tan, J., Wu, K., Liu, J., Li, Y., Sang, K., & Giordano, A. (2026) · Journal of Asian Architecture and Building Engineering · doi:10.1080/13467581.2026.2739676
He, Y., Omar, A. C., & Salam, S. N.-A. (2026) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2026.0170930
Chung, N. H. T., Cam, T. A., & Đức, N. H. (2026) · Information Discovery and Delivery · doi:10.1108/idd-04-2026-0120
VISUALIZING RESEARCH ON INTERNATIONAL FACULTY MEMBERS IN HIGHER EDUCATION: A CITESPACE ANALYSIS
Shuang Li*, A. K. (2023) · Journal of Research Administration
Identification of Scientific Researchers at the Early Stage of Field of Study Trends
Zafar, L., Masood, N., Hadi, F., & Ahmed, S. (2024) · Journal of Computing & Biomedical Informatics
User-guided dynamic topic discovery in large texts
Ramanan, K. V. (2023) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
Dong, S., Lian, Y., Xie, J., Cao, S., Yang, J., Qi, F., & Liu, Q. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1964791
Lu, K., & Li, J. (2026) · International Conference on Digital Economy and Information Systems · doi:10.1145/3845872.3845917
Research Progress in Ecological Corridor Identification Tools: A Bibliometric Analysis
Sun, R., & Zhu, M. (2026) · International Conference on Sustainable Development and Digital Transformation · doi:10.1145/3838938.3838985
Gümüş, E. Ç. (2026) · Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry · doi:10.18863/pgy.2019434
Estimating Name Recognition of Public Figures from the Web
Kobayashi, S., & Tajima, K. (2026) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/3805696.3846487
Following the Wave or Riding Alone? A Decade of Thematic Evolution at SBBD vs. VLDB
de Melo, T. (2026) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2026.249339
Liu, T., & Xu, X. (2026) · The Journal of Korean Association of Computer Education · doi:10.32431/kace.2026.29.9.003
Zeng, X., Yao, J., Mo, L., & Huang, X. (2026) · Frontiers in Oncology · doi:10.3389/fonc.2026.1939505
Lu, J., Delibes, G. G.-B., & Rodriguez, J. B. (2026) · Systems · doi:10.3390/systems14101315
Afrin, F. (2025) · Innovative Construction and Petrochemical Technologies
Fuji: The Shape, Composition, and Spread of Demand Bursts on Robinhood ChainPreprint
Anchuri, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.35738
Gracia, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.34245
Evidence-constrained LLM reasoning framework: emerging technology evolution and rupture detection
Yang, M., Zhao, X., Wu, Y., & Cui, Y. (2026) · Scientometrics · doi:10.1007/s11192-026-05835-3
Exploring the potential of quantum computing on current and future technologies
Sharma, C., & Sood, S. K. (2026) · Computer Science Review · doi:10.1016/j.cosrev.2026.101092
Du, C., Li, Y., Piao, W., Quan, Y., & Jin, B. (2026) · Sustainability · doi:10.3390/su182211512
Zhou, T., Zhang, F., He, H., Wang, F., Chen, T., Bai, F., 李雪芹, Li, W., & Shen, Y. (2026) · Tissue Engineering and Regenerative Medicine · doi:10.1007/s13770-026-00851-z
Supporting information 3 of Modeling information diffusion in social media: data-driven observations
Iamnitchi, A., Hall, L. O., Horawalavithana, S., Mubang, F., Ng, K. W., & Skvoretz, J. (2023) · doi:10.3389/fdata.2023.1135191.s003
Du, X., Chen, C., Xiao, Y., Cui, Y., Yang, L., Li, X., Liu, X., Wang, R., & Tan, B. (2022) · doi:10.3389/fonc.2022.1055366.s001
Yi, L.-J., Liu, Y., Tang, L., Cheng, L., Wang, G.-H., Hu, S.-W., Liu, X.-L., Tian, X., & Jiménez-Herrera, M. F. (2022) · doi:10.3389/fpsyg.2022.890327.s001
Anticipatory Event Detection for Bursty Events
Chang, K., He, Q., Aminuddin, R., Suri, R., & Lim, E. (2007) · Springer eBooks · doi:10.1007/978-3-540-71549-8_19
Metadata
- Authors
- Kleinberg, J.
- Affiliations
- Cornell University (US)
- Corresponding author
- Kleinberg, Jon
- ORCID
- Kleinberg, Jon
- Venue
- Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
- Publisher
- ACM
- Published
- 2002-07-23
- Pages
- 91-101
- OpenAlex
- W2026302857
- Cited by
- 1,337
- References
- 65
- Citations by year
- 2026: 101 · 2025: 68 · 2024: 63 · 2023: 77 · 2022: 43 · 2021: 44 · 2020: 45 · 2019: 41 · 2018: 58 · 2017: 61 · 2016: 59 · 2015: 92 · 2014: 73 · 2013: 81 · 2012: 70
- FWCI
- 19.27
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (publishedVersion)
- eCommons (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- document streams, burst detection, hierarchy, state transitions, email, topic emergence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.