Open domain event extraction from twitter
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Tweets are the most up-to-date and inclusive stream of in- formation and commentary on current events, but they are also fragmented and noisy, motivating the need for systems that can extract, aggregate and categorize important events. Previous work on extracting structured representations of events has focused largely on newswire text; Twitter's unique characteristics present new challenges and opportunities for open-domain event extraction. This paper describes TwiCal-- the first open-domain event-extraction and categorization system for Twitter. We demonstrate that accurately extracting an open-domain calendar of significant events from Twitter is indeed feasible. In addition, we present a novel approach for discovering important event categories and classifying extracted events based on latent variable models. By leveraging large volumes of unlabeled data, our approach achieves a 14% increase in maximum F1 over a supervised baseline. A continuously updating demonstration of our system can be viewed at http://statuscalendar.com; Our NLP tools are available at http://github.com/aritter/ twitter_nlp.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049 · cited 4×
“For inference we use collapsed Gibbs Sampling [20] where each hidden variable, zi, is sampled in turn, and parameters are integrated out.”
MethodInfluentialEarthquake shakes Twitter users: real-time event detection by social sensors
Sakaki, T., Okazaki, M., & Matsuo, Y. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772777 · Cited by 3,640
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Accurate methods for the statistics of surprise and coincidence
Dunning, T. E. (1993) · doi:10.5555/972450.972454 · Cited by 2,647
Meme-tracking and the dynamics of the news cycle
Leskovec, J., Backstrom, L., & Kleinberg, J. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557077 · Cited by 1,530
Named Entity Recognition in Tweets: An Experimental Study
Ritter, A., Clark, S., & Etzioni, O. (2011) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 1,496
Self-citationMessage Understanding Conference-6: a brief history
Grishman, R., & Sundheim, B. (1996) · Proceedings of the 16th conference on Computational linguistics - · doi:10.3115/992628.992709 · Cited by 1,408
Open information extraction from the web
Banko, M., Cafarella, M., Soderland, S. G., Broadhead, M., & Etzioni, O. (2007) · International Joint Conference on Artificial Intelligence · Cited by 1,398
Self-citationIdentifying Relations for Open Information Extraction
Fader, A., Soderland, S. G., & Etzioni, O. (2011) · Cited by 1,144
Self-citationThe Automatic Content Extraction (ACE) Program – Tasks, Data, and Evaluation
Doddington, G. R., Mitchell, A., Przybocki, M. A., Ramshaw, L., Strassel, S. M., & Weischedel, R. (2004) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/4o6ysc5sicba · Cited by 1,029
Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
Gimpel, K., Schneider, N., O'Connor, B., Das, D., Mills, D. P., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2018) · Figshare · doi:10.1184/r1/6473609.v1 · Cited by 800
Data-Driven Response Generation in Social Media
Ritter, A., Cherry, C., & Dolan, W. B. (2011) · NPARC · Cited by 742
Self-citationA study of retrospective and on-line event detection
Yang, Y., Pierce, T., & Carbonell, J. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290953 · Cited by 731
Beyond Trending Topics: Real-World Event Identification on Twitter
Becker, H., Naaman, M., & Gravano, L. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v5i1.14146 · Cited by 680
On-Line New Event Detection and Tracking
Allan, J., Papka, R., & Lavrenko, V. (2017) · ACM SIGIR Forum · doi:10.1145/3130348.3130366 · Cited by 646
A Latent Variable Model for Geographic Lexical Variation
Eisenstein, J., O'Connor, B., Smith, N. A., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6475412 · Cited by 584
Streaming First Story Detection with application to Twitter
Petrović, S., Osborne, M., & Lavrenko, V. P. (2010) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 573
On-line new event detection and tracking
Allan, J., Papka, R., & Lavrenko, V. (1998) · Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/290941.290954 · Cited by 530
Unsupervised Modeling of Twitter Conversations
Ritter, A., Cherry, C., & Dolan, B. (2010) · NPARC · Cited by 528
Self-citationMixed-membership models of scientific publications
Erosheva, E., Fienberg, S., & Lafferty, J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307760101 · Cited by 442
Efficient methods for topic model inference on streaming document collections
Yao, L., Mimno, D., & McCallum, A. (2009) · Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1557019.1557121 · Cited by 410
Recognizing Named Entities in Tweets
Liu, X., Zhang, S., Wei, F., & Zhou, M. (2011) · Cited by 387
Automatic Labelling of Topic Models
Lau, J. H., Grieser, K., Newman, D. J., & Baldwin, T. (2011) · Cited by 285
Machine learning of temporal relations
Mani, I., Verhagen, M., Wellner, B., Lee, C. M., & Pustejovsky, J. (2006) · Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL - ACL '06 · doi:10.3115/1220175.1220270 · Cited by 282
Distributed Inference for Latent Dirichlet Allocation
Newman, D. J., Smyth, P., Welling, M., & Asuncion, A. (2007) · neural information processing systems · Cited by 254
Newsjunkie: providing personalized newsfeeds via analysis of information novelty
Gabrilovich, E., Dumais, S., & Horvitz, E. (2004) · Proceedings of the 13th international conference on World Wide Web · doi:10.1145/988672.988738 · Cited by 220
Text classification and named entities for new event detection
Kumaran, G., & Allan, J. (2004) · Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1008992.1009044 · Cited by 220
Event Discovery in Social Media Feeds
Benson, E., Haghighi, A., & Barzilay, R. (2011) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 187
Mark My Words! Linguistic Style Accommodation in Social Media
Danescu-Niculescu-Mizil, C., Gamon, M., & Dumais, S. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1105.0673 · Cited by 185
Classifying temporal relations between events
Chambers, N., Wang, S., & Jurafsky, D. (2007) · Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions - ACL '07 · doi:10.3115/1557769.1557820 · Cited by 177
Proceedings of the Sixth Workshop on Statistical Machine Translation.
Callison-Burch, C., Koehn, P., Monz, C., & Zaidan, O. F. (2011) · Cited by 169
Temporal Information Extraction
Ling, X., & Weld, D. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7512 · Cited by 153
Structured Relation Discovery using Generative Models
Yao, L., Haghighi, A., Riedel, S., & McCallum, A. (2011) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 150
A Latent Dirichlet Allocation Method for Selectional Preferences
Ritter, A., & Etzioni, O. (2010) · Cited by 149
Self-citationRobust temporal processing of news
Mani, I., & Wilson, G. (2000) · Proceedings of the 38th Annual Meeting on Association for Computational Linguistics - ACL '00 · doi:10.3115/1075218.1075228 · Cited by 142
Smoothing techniques for adaptive online language models: topic tracking in tweet streams
Lin, J., Snow, R., & Morgan, W. (2011) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2020408.2020476 · Cited by 121
Discovering Sociolinguistic Associations with Structured Sparsity
Eisenstein, J., Smith, N. A., & Xing, E. P. (2018) · Figshare · doi:10.1184/r1/6475556 · Cited by 121
Mark my words!: linguistic style accommodation in social media
Danescu-Niculescu-Mizil, C., Gamon, M., & Dumais, S. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963509 · Cited by 113
Latent Variable Models of Selectional Preference
Séaghdha, D. Ó. (2010) · Cited by 100
Using Wikipedia to bootstrap open information extraction
Weld, D. S., Hoffmann, R., & Wu, F. Q. (2009) · ACM SIGMOD Record · doi:10.1145/1519103.1519113 · Cited by 72
Crisis MT: Developing A Cookbook for MT in Crisis Situations
Lewis, W. D., Munro, R., & Vogel, S. (2011) · Workshop on Statistical Machine Translation · Cited by 71
Linguistic Redundancy in Twitter
Zanzotto, F. M., Pennaccchiotti, M., & Tsioutsiouliklis, K. (2011) · Cineca Institutional Research Information System (Tor Vergata University) · Cited by 68
Learning Arguments and Supertypes of Semantic Relations Using Recursive Patterns
Kozareva, Z., & Hovy, E. H. (2010) · Cited by 54
Safety Information Mining — What can NLP do in a disaster—
Neubig, G., Matsubayashi, Y., Hagiwara, M., & Murakami, K. (2011) · International Joint Conference on Natural Language Processing · Cited by 50
Tense Interpretation in the Context of Narrative
Song, F., & Cohen, R. A. (2005) · doi:10.1093/oso/9780199268535.003.0022 · Cited by 43
(2010)
Cited by
A survey on sentiment analysis methods, applications, and challenges
Wankhade, M., Rao, A. C. S., & Kulkarni, C. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-022-10144-1 · Cited by 1,528
SemEval-2016 Task 4: Sentiment Analysis in Twitter
Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., & Stoyanov, V. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1001 · Cited by 966
Self-citationProcessing Social Media Messages in Mass Emergency: A Survey
Imran, M., Castillo, C., Diaz, F., & Vieweg, S. (2015) · ACM Computing Surveys · doi:10.1145/2771588 · Cited by 804
Social media analytics – Challenges in topic discovery, data collection, and data preparation
Stieglitz, S., Mirbabaie, M., Ross, B., & Neuberger, C. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2017.12.002 · Cited by 803
Adaptive Co-attention Network for Named Entity Recognition in Tweets
Zhang, Q., Fu, J., Liu, X., & Huang, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11962 · Cited by 381
Metadata
- Authors
- Ritter, A., Mausam, Etzioni, O., & Clark, S.
- Venue
- Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
- Publisher
- ACM
- Published
- 2012-08-12
- Pages
- 1104-1112
- OpenAlex
- W2123661878
- Cited by
- 592
- References
- 47
- FWCI
- 41.11
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.