The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Generation of a new IDS test dataset: Time to retire the KDD collection
Abstract
Intrusion detection systems are generally tested using datasets compiled at the end of last century, justified by the need for publicly available test data and the lack of any other alternative datasets. Prominent amongst this legacy group is the KDD project. Whilst a seminal contribution at the time of compilation, these datasets no longer represent relevant architecture or contemporary attack protocols, and are beset by data corruptions and inconsistencies. Hence, testing of new IDS approaches against these datasets does not provide an effective performance metric, and contributes to erroneous efficacy claims. This paper introduces a new publicly available dataset which is representative of modern attack structure and methodology. The new dataset is contrasted with the legacy datasets, and the performance difference of commonly used intrusion detection algorithms is highlighted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Intrusion detection using sequences of system calls
Hofmeyr, S. A., Forrest, S., & Somayaji, A. (1998) · Journal of Computer Security · doi:10.3233/jcs-980109 · Cited by 1,313
McHugh, J. (2000) · ACM Transactions on Information and System Security · doi:10.1145/382912.382923 · Cited by 1,309
A data mining framework for building intrusion detection models
Lee, W., Stolfo, S. J., & Mok, K. W. (2003) · Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344) · doi:10.1109/secpri.1999.766909 · Cited by 1,148
Detecting intrusions using system calls: alternative data models
Warrender, C., Forrest, S., & Pearlmutter, B. (2003) · Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344) · doi:10.1109/secpri.1999.766910 · Cited by 1,106
A sense of self for Unix processes
Forrest, S., Hofmeyr, S. A., Somayaji, A., & Longstaff, T. A. (2002) · Proceedings 1996 IEEE Symposium on Security and Privacy · doi:10.1109/secpri.1996.502675 · Cited by 874
Architecture for an Artificial Immune System
Hofmeyr, S. A., & Forrest, S. (2000) · Evolutionary Computation · doi:10.1162/106365600568257 · Cited by 867
Forrest, S., Hofmeyr, S. A., & Somayaji, A. (1997) · Communications of the ACM · doi:10.1145/262793.262811 · Cited by 848
An Analysis of the 1999 DARPA/Lincoln Laboratory Evaluation Data for Network Anomaly Detection
Mahoney, M. V., & Chan, P. K. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45248-5_13 · Cited by 535
Application of SVM and ANN for intrusion detection
Chen, W.-H., Hsu, S.-H., & Shen, H.-P. (2005) · Computers & Operations Research · doi:10.1016/j.cor.2004.03.019 · Cited by 412
Host-based intrusion detection using dynamic and static behavioral models
Yeung, D.-Y., & Ding, Y. (2003) · Pattern Recognition · doi:10.1016/s0031-3203(02)00026-2 · Cited by 349
Cited by
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
“ADFA (University of New South Wales 2013): This dataset includes normal training and validating data and 10 attacks per vector (Creech and Hu, 2013).”
MethodA survey of network anomaly detection techniques
Ahmed, M., Naser Mahmood, A., & Hu, J. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2015.11.016 · Cited by 1,750
Self-citationMalware traffic classification using convolutional neural network for representation learning
Wang, W., Zhu, M., Zeng, X., Ye, X., & Sheng, Y. (2017) · 2017 International Conference on Information Networking (ICOIN) · doi:10.1109/icoin.2017.7899588 · Cited by 1,177
“…learning approaches focus on feature selection techniques, many current public traffic datasets are flow features datasets other than raw traffic datasets, e.g. famous KDD CUP1999 and NSL-KDD provide pre-defined 41 features in their dataset [11], and there are many similar datasets, such as [14].”
BackgroundDeep learning for cyber security intrusion detection: Approaches, datasets, and comparative study
Ferrag, M. A., Maglaras, L., Moschoyiannis, S., & Janicke, H. (2020) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2019.102419 · Cited by 1,130
A survey of network-based intrusion detection data sets
Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A. (2019) · Computers & Security · doi:10.1016/j.cose.2019.06.005 · Cited by 947
Survey on SDN based network intrusion detection system using machine learning approaches
Sultana, N., Chilamkurti, N., Peng, W., & Alhadad, R. (2019) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-017-0630-0 · Cited by 507
A systematic literature review of methods and datasets for anomaly-based network intrusion detection
Yang, Z., Liu, X., Li, T., Wu, D., Wang, J., Zhao, Y., & Han, H. (2022) · Computers & Security · doi:10.1016/j.cose.2022.102675 · Cited by 453
Explainable Artificial Intelligence Applications in Cyber Security: State-of-the-Art in Research
Zhang, Z., Hamadi, H. A., Damiani, E., Yeun, C. Y., & Taher, F. (2022) · IEEE Access · doi:10.1109/access.2022.3204051 · Cited by 450
InSDN: A Novel SDN Intrusion Dataset
Elsayed, M. S., Le-Khac, N.-A., & Jurcut, A. D. (2020) · IEEE Access · doi:10.1109/access.2020.3022633 · Cited by 414
Artificial intelligence, cyber-threats and industry 4.0: challenges and opportunities
Bécue, A., Praça, I., & Gama, J. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09942-2 · Cited by 368
Thakkar, A., & Lohiya, R. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10037-9 · Cited by 350
UNICORN: Runtime Provenance-Based Detector for Advanced Persistent Threats
Han, X., Pasquier, T., Bates, A., Mickens, J., & Seltzer, M. (2020) · Proceedings 2020 Network and Distributed System Security Symposium · doi:10.14722/ndss.2020.24046 · Cited by 349
“…for several reasons: A) many IDS are not open-source; B) existing public IDS datasets are either outdated [4], [85] or require a translation [28], [50], [51] from, e.g., syscall traces to data provenance, which is challenging and sometimes impossible (due to lack of information); C) systems…”
BackgroundTowards a Reliable Intrusion Detection Benchmark Dataset
Sharafaldin, I., Canadian Institute for Cybersecurity (CIC), U., Gharib, A., Canadian Institute for Cybersecurity (CIC), U., Lashkari, A. H., Canadian Institute for Cybersecurity (CIC), U., Ghorbani, A. A., & Canadian Institute for Cybersecurity (CIC), U. (2017) · Software Networking · doi:10.13052/jsn2445-9739.2017.009 · Cited by 302
A Review of the Advancement in Intrusion Detection Datasets
Thakkar, A., & Lohiya, R. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.03.330 · Cited by 290
A Taxonomy of Network Threats and the Effect of Current Datasets on Intrusion Detection Systems
Hindy, H., Brosset, D., Bayne, E., Seeam, A. K., Tachtatzis, C., Atkinson, R., & Bellekens, X. (2020) · IEEE Access · doi:10.1109/access.2020.3000179 · Cited by 273
LITNET-2020: An Annotated Real-World Network Flow Dataset for Network Intrusion Detection
Damasevicius, R., Venckauskas, A., Grigaliunas, S., Toldinas, J., Morkevicius, N., Aleliunas, T., & Smuikys, P. (2020) · Electronics · doi:10.3390/electronics9050800 · Cited by 132
Soe, Y. N., Feng, Y., Santosa, P. I., Hartanto, R., & Sakurai, K. (2020) · Electronics · doi:10.3390/electronics9010144 · Cited by 110
Machine-Learning Techniques for Detecting Attacks in SDN
Elsayed, M. S., Le-Khac, N.-A., Dev, S., & Jurcut, A. D. (2019) · 2019 IEEE 7th International Conference on Computer Science and Network Technology (ICCSNT) · doi:10.1109/iccsnt47585.2019.8962519 · Cited by 72
Ayodeji, A., Liu, Y.-K., Chao, N., & Yang, L.-Q. (2020) · Nuclear Engineering and Technology · doi:10.1016/j.net.2020.05.012 · Cited by 66
Landauer, M., Skopik, F., & Wurzenberger, M. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660768 · Cited by 61
“When Creech et al. [6] published the ADFA data set in 2013, they attempted to replace data sets such as KDD99 that were already criticized and considered outdated at that time [31].”
MethodKus, D., Wagner, E., Pennekamp, J., Wolsing, K., Fink, I. B., Dahlmanns, M., Wehrle, K., & Henze, M. (2022) · Proceedings of the 8th ACM on Cyber-Physical System Security Workshop · doi:10.1145/3494107.3522773 · Cited by 28
LLM meets ML: Data-efficient Anomaly Detection on Unstable Logs
Hadadi, F., Xu, Q., Bianculli, D., & Briand, L. (2024) · arXiv · doi:10.48550/arxiv.2406.07467 · Cited by 7
Metadata
- Authors
- Creech, G., & Hu, J.
- Venue
- 2013 IEEE Wireless Communications and Networking Conference (WCNC)
- Publisher
- IEEE
- Published
- 2013-04
- Pages
- 4487-4492
- ISSN
- 1525-3511 (ISSN-L)
- OpenAlex
- W1981738628
- Cited by
- 320
- References
- 21
- FWCI
- 6.93
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.