The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Event labeling combining ensemble detectors and background knowledge
Open accessAbstract
Event labeling is the process of marking events in unlabeled data. Traditionally, this is done by involving one or more human experts through an expensive and time-consuming task. In this article we propose an event labeling system relying on an ensemble of detectors and background knowledge. The target data are the usage log of a real bike sharing system. We first label events in the data and then evaluate the performance of the ensemble and individual detectors on the labeled data set using ROC analysis and static evaluation metrics in the absence and presence of background knowledge. Our results show that when there is no access to human experts, the proposed approach can be an effective alternative for labeling events. In addition to the main proposal, we conduct a comparative study regarding the various predictive models performance, semi-supervised and unsupervised approaches, train data scale, time series filtering methods, online and offline predictive models, and distance functions in measuring time series similarity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687 · cited 1×
“It is sometimes interpreted as a sub-category of anomaly [11] or in some circumstances equivalent to anomaly [29] or change [24].”
BackgroundAbdi, H., & Williams, L. J. (2010) · WIREs Computational Statistics · doi:10.1002/wics.101 · Cited by 11,104
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · cited 1×
“Instead we use Fleiss’s kappa [18] which is a statistics that measures the level of agreement between multiple raters when assigning categorical ratings to a number of items or classifying items.”
MethodEnsemble methods in machine learning
Dietterich, T. G. (2000) · Lecture Notes in Computer Science · doi:10.1007/3-540-45014-9_1 · Cited by 8,408
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Combining Pattern Classifiers: Methods and Algorithms
Bagui, S. C. (2005) · Technometrics · doi:10.1198/tech.2005.s320 · Cited by 3,202
Combining Pattern Classifiers: Methods and Algorithms
Kuncheva, L. I. (2004) · Wiley eBooks · doi:10.1002/0471660264 · Cited by 3,005
Assessing Agreement on Classification Tasks: The Kappa Statistic
Carletta, J. (1996) · arXiv · doi:10.48550/arxiv.cmp-lg/9602004 · Cited by 2,088 · cited 1×
“Since we want to evaluate the overall agreement rate between all detectors and not individual agreements between pairs of detectors, we cannot use the common Cohen’s kappa [10].”
MethodBleiholder, J., & Naumann, F. (2009) · ACM Computing Surveys · doi:10.1145/1456650.1456651 · Cited by 1,838
McHugh, J. (2000) · ACM Transactions on Information and System Security · doi:10.1145/382912.382923 · Cited by 1,309
Detecting intrusions using system calls: alternative data models
Warrender, C., Forrest, S., & Pearlmutter, B. (2003) · Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344) · doi:10.1109/secpri.1999.766910 · Cited by 1,106
Mining anomalies using traffic feature distributions
Lakhina, A., Crovella, M., & Diot, C. (2005) · Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/1080091.1080118 · Cited by 1,054
Diagnosing network-wide traffic anomalies
Lakhina, A., Crovella, M., & Diot, C. (2004) · Proceedings of the 2004 conference on Applications, technologies, architectures, and protocols for computer communications · doi:10.1145/1015467.1015492 · Cited by 1,039
The 1999 DARPA off-line intrusion detection evaluation
Lippmann, R., Haines, J. W., Fried, D. J., Korba, J., & Das, K. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00139-0 · Cited by 876
A signal analysis of network traffic anomalies
Barford, P., Kline, J., Plonka, D., & Ron, A. (2002) · Proceedings of the second ACM SIGCOMM Workshop on Internet measurment - IMW '02 · doi:10.1145/637201.637210 · Cited by 787
Difficulties in simulating the Internet
Floyd, S., & Paxson, V. (2001) · IEEE/ACM Transactions on Networking · doi:10.1109/90.944338 · Cited by 721
Collaborative location and activity recommendations with GPS history data
Zheng, V. W., Zheng, Y., Xie, X., & Yang, Q. (2010) · Proceedings of the 19th international conference on World wide web · doi:10.1145/1772690.1772795 · Cited by 661
Event detection from time series data
Guralnik, V., & Srivastava, J. (1999) · Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/312129.312190 · Cited by 474
Witten, I. H., Frank, E., & Hall, M. A. (2011) · Data Mining: Practical Machine Learning Tools and Techniques · doi:10.1016/b978-0-12-374856-0.00001-8 · Cited by 420
Diagnosing network-wide traffic anomalies
Lakhina, A., Crovella, M., & Diot, C. (2004) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1030194.1015492 · Cited by 419
Learning Program Behavior Profiles for Intrusion Detection
Ghosh, A. K., Schwartzbard, A., & Schatz, M. X. (1999) · Cited by 394
The Design Inference: Eliminating Chance through Small Probabilities
Dembski, W. A. (1998) · doi:10.1017/cbo9780511570643 · Cited by 372
ANTIDOTE: understanding and defending against poisoning of anomaly detectors
Rubinstein, B. I. P., Nelson, B., Huang, L., Joseph, A. D., Lau, S.-H., Rao, S., Taft, N., & Tygar, J. D. (2009) · Proceedings of the 9th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1644893.1644895 · Cited by 331
Understanding Bike-Sharing Systems using Data Mining: Exploring Activity Patterns
Vogel, P., Greiser, T., & Mattfeld, D. C. (2011) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2011.08.058 · Cited by 322
Learning model trees from evolving data streams
Ikonomovska, E., Gama, J., & Džeroski, S. (2011) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-010-0201-y · Cited by 304
Self-citationAn empirical evaluation of entropy-based traffic anomaly detection
Nychis, G., Sekar, V., Andersen, D. G., Kim, H., & Zhang, H. (2008) · Proceedings of the 8th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1452520.1452539 · Cited by 300
Fontugne, R., Borgnat, P., Abry, P., & Fukuda, K. (2010) · Proceedings of the 6th International COnference · doi:10.1145/1921168.1921179 · Cited by 295 · cited 4×
“The benefit of combining different detectors relies on diversity among detectors ensembles [20].”
BackgroundInfluentialSHARED BICYCLES IN A CITY: A SIGNAL PROCESSING AND DATA ANALYSIS PERSPECTIVE
BORGNAT, P., ABRY, P., FLANDRIN, P., ROBARDET, C., ROUQUIER, J.-B., & FLEURY, E. (2011) · Advances in Complex Systems · doi:10.1142/s0219525911002950 · Cited by 250
BioCaster: detecting public health rumors with a Web-based text mining system
Collier, N., Doan, S., Kawazoe, A., Goodwin, R. M., Conway, M., Tateno, Y., Ngo, Q.-H., Dien, D., Kawtrakul, A., Takeuchi, K., et al. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn534 · Cited by 240
Detection and identification of network anomalies using sketch subspaces
Li, X., Bian, F., Crovella, M., Diot, C., Govindan, R., Iannaccone, G., & Lakhina, A. (2006) · Proceedings of the 6th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1177080.1177099 · Cited by 232
Intrusion detection in computer networks by a modular ensemble of one-class classifiers
Giacinto, G., Perdisci, R., Del Rio, M., & Roli, F. (2008) · Information Fusion · doi:10.1016/j.inffus.2006.10.002 · Cited by 218
Outlier ensembles: position paper
Aggarwal, C. C. (2013) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2481244.2481252 · Cited by 192
Using Webcast Text for Semantic Event Detection in Broadcast Sports Video
Xu, C., Zhang, Y., Zhu, G., et al. (2008) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2008.2004912 · Cited by 148
Non-Gaussian and Long Memory Statistical Characterizations for Internet Traffic with Anomalies
Scherrer, A., Larrieu, N., Owezarski, P., Borgnat, P., & Abry, P. (2007) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2007.12 · Cited by 141
Dewaele, G., Fukuda, K., Borgnat, P., Abry, P., & Cho, K. (2007) · doi:10.1145/1352664.1352675 · Cited by 118
A Bayesian paradigm for designing intrusion detection systems
Scott, S. L. (2003) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(03)00177-4 · Cited by 81
An Ontology for Event Detection and its Application in Surveillance Video
SanMiguel, J. C., Martínez, J. M., & García, Á. (2009) · IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) · doi:10.1109/avss.2009.28 · Cited by 68
Wong, W., Moore, A., Cooper, G. F., & D, M. M. W. M. (2005) · Journal of Machine Learning Research · Cited by 67
Anomaly extraction in backbone networks using association rules
Brauckhoff, D., Dimitropoulos, X. A., Wagner, A., & Salamatian, K. (2009) · ACM Internet Measurement Conference (IMC) · doi:10.1145/1644893.1644897 · Cited by 57
Accurate anomaly detection through parallelism
Shanbhag, S., & Wolf, T. (2009) · IEEE Network · doi:10.1109/mnet.2009.4804320 · Cited by 52
Topical anomaly detection from Twitter stream
Anantharam, P., Thirunarayan, K., & Sheth, A. (2012) · ACM Web Science Conference (WebSci) · doi:10.1145/2380718.2380720 · Cited by 26
Ringberg, H., Soule, A., & Rexford, J. (2008) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1341431.1341437 · Cited by 24
An Information-Theoretic Combining Method for Multi-Classifier Anomaly Detection Systems
Ashfaq, A. B., Javed, M., Khayam, S. A., & Radha, H. (2010) · International Conference on Communications · doi:10.1109/icc.2010.5501984 · Cited by 21
Performance Evaluation of Anomaly-Based Detection Mechanisms
Tan, K. M. C., & Maxion, R. A. (2004) · Newcastle University ePrints (Newcastle Univesity) · doi:10.25405/ncl.34129551 · Cited by 2
Cited by
Visualizing the effects of predictor variables in black box supervised learning models
Apley, D. W., & Zhu, J. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12377 · Cited by 1,535
Fraud detection: A systematic literature review of graph-based anomaly detection approaches
Pourhabibi, T., Ong, K.-L., Kam, B. H., & Boo, Y. L. (2020) · Decision Support Systems · doi:10.1016/j.dss.2020.113303 · Cited by 434
Sagheer, A., & Kotb, M. (2019) · Scientific Reports · doi:10.1038/s41598-019-55320-6 · Cited by 351
Hooker, G., Mentch, L., & Zhou, S. (2021) · Statistics and Computing · doi:10.1007/s11222-021-10057-z · Cited by 264
Privacy-preserving distributed linear regression on high-dimensional data
Gascón, A., Schoppmann, P., Balle, B., Raykova, M., Doerner, J., Zahur, S., & Evans, D. (2017) · Proceedings on Privacy Enhancing Technologies · doi:10.1515/popets-2017-0053 · Cited by 193
Metadata
- Authors
- Fanaee-T, H., & Gama, J.
- Venue
- Progress in Artificial Intelligence
- Published
- 2013-11-26
- Volume
- 2
- Issue
- 2-3
- Pages
- 113-127
- ISSN
- 2192-6352 (ISSN-L)
- 2192-6360
- OpenAlex
- W2006398000
- Cited by
- 415
- References
- 47
- FWCI
- 23.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.