The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
A survey of network-based intrusion detection data sets
Open accessAbstract
Abstract Labeled data sets are necessary to train and evaluate anomaly-based network intrusion detection systems. This work provides a focused literature survey of data sets for network-based intrusion detection and describes the underlying packet- and flow-based network data in detail. The paper identifies 15 different properties to assess the suitability of individual data sets for specific evaluation scenarios. These properties cover a wide range of criteria and are grouped into five categories such as data volume or recording environment for offering a structured search. Based on these properties, a comprehensive overview of existing data sets is given. This overview also highlights the peculiarities of each data set. Furthermore, this work briefly touches upon other sources for network-based data such as traffic generators and data repositories. Finally, we discuss our observations and provide some recommendations for the use and the creation of network-based data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423
He, H., & Garcia, E. A. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2008.239 · Cited by 10,359
McKeown (2008) · doi:10.1145/1355734.1355746 · Cited by 8,513
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
Moustafa, N., & Slay, J. (2015) · 2015 Military Communications and Information Systems Conference (MilCIS) · doi:10.1109/milcis.2015.7348942 · Cited by 4,033
A Survey of Data Mining and Machine Learning Methods for Cyber Security Intrusion Detection
Buczak, A. L., & Guven, E. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2494502 · Cited by 3,332
Outside the Closed World: On Using Machine Learning for Network Intrusion Detection
Sommer, R., & Paxson, V. (2010) · 2010 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2010.25 · Cited by 2,085
Network Anomaly Detection: Methods, Systems and Tools
Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.052213.00046 · Cited by 1,348
Toward developing a systematic approach to generate benchmark datasets for intrusion detection
Shiravi, A., Shiravi, H., Tavallaee, M., & Ghorbani, A. A. (2012) · Computers & Security · doi:10.1016/j.cose.2011.12.012 · Cited by 1,345
McHugh, J. (2000) · ACM Transactions on Information and System Security · doi:10.1145/382912.382923 · Cited by 1,309
An empirical comparison of botnet detection methods
García, S., Grill, M., Stiborek, J., & Zunino, A. (2014) · Computers & Security · doi:10.1016/j.cose.2014.05.011 · Cited by 962
Cisco Systems NetFlow Services Export Version 9
(2004) · doi:10.17487/rfc3954 · Cited by 954
Evaluating intrusion detection systems: the 1998 DARPA off-line intrusion detection evaluation
Lippmann, R. P., Fried, D. J., Graf, I., Haines, J. W., Kendall, K. R., McClung, D., Weber, D., Webster, S. E., Wyschogrod, D., Cunningham, R. K., et al. (2002) · Proceedings DARPA Information Survivability Conference and Exposition. DISCEX'00 · doi:10.1109/discex.2000.821506 · Cited by 917
The 1999 DARPA off-line intrusion detection evaluation
Lippmann, R., Haines, J. W., Fried, D. J., Korba, J., & Das, K. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00139-0 · Cited by 876
Fast portscan detection using sequential hypothesis testing
Jung, J., Paxson, V., Berger, A. W., & Balakrishnan, H. (2004) · IEEE Symposium on Security and Privacy, 2004. Proceedings. 2004 · doi:10.1109/secpri.2004.1301325 · Cited by 660
Proceedings IEEE Wireless Communications and Networking Conference (WCNC)
Onat, F. A., Fan, Y., Yanıkömeroğlu, H., & Thompson, J. (2008) · Cited by 660
Random-Forests-Based Network Intrusion Detection Systems
Zhang, J., Zulkernine, M., & Haque, A. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.923876 · Cited by 574
Intrusion Detection in 802.11 Networks: Empirical Evaluation of Threats and a Public Dataset
Kolias, C., Kambourakis, G., Stavrou, A., & Gritzalis, S. (2016) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2015.2402161 · Cited by 550
A new approach to intrusion detection using Artificial Neural Networks and fuzzy clustering
Wang, G., Hao, J., Ma, J., & Huang, L. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.02.102 · Cited by 505
Proceedings 2002 IEEE Symposium on Security and Privacy
(2002) · doi:10.1109/secpri.2002 · Cited by 374
Proceedings of the 2013 IEEE International Conference on Big Data
Hu, X. T., Lin, T. Y., Raghavan, V. V., Wah, B. W.-S., Baeza-Yates, R. A., Fox, G., Shahabi, C., & Yang, Q. (2013) · International Conference on Big Data · Cited by 357
Statistical analysis of honeypot data and building of Kyoto 2006+ dataset for NIDS evaluation
Song, J., Takakura, H., Okabe, Y., Eto, M., Inoue, D., & Nakao, K. (2011) · Proceedings of the First Workshop on Building Analysis Datasets and Gathering Experience Returns for Security · doi:10.1145/1978672.1978676 · Cited by 334
Generation of a new IDS test dataset: Time to retire the KDD collection
Creech, G., & Hu, J. (2013) · 2013 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2013.6555301 · Cited by 320
Towards a Reliable Intrusion Detection Benchmark Dataset
Sharafaldin, I., Canadian Institute for Cybersecurity (CIC), U., Gharib, A., Canadian Institute for Cybersecurity (CIC), U., Lashkari, A. H., Canadian Institute for Cybersecurity (CIC), U., Ghorbani, A. A., & Canadian Institute for Cybersecurity (CIC), U. (2017) · Software Networking · doi:10.13052/jsn2445-9739.2017.009 · Cited by 302
Fontugne, R., Borgnat, P., Abry, P., & Fukuda, K. (2010) · Proceedings of the 6th International COnference · doi:10.1145/1921168.1921179 · Cited by 295
Fan, J., Xu, J., Ammar, M. H., & Moon, S. B. (2004) · Computer Networks · doi:10.1016/j.comnet.2004.03.033 · Cited by 288
Towards effective feature selection in machine learning-based botnet detection approaches
Biglar Beigi, E., Hadian Jazi, H., Stakhanova, N., & Ghorbani, A. A. (2014) · 2014 IEEE Conference on Communications and Network Security · doi:10.1109/cns.2014.6997492 · Cited by 273
Detecting P2P botnets through network behavior analysis and machine learning
Saad, S., Traore, I., Ghorbani, A., Sayed, B., Zhao, D., Lu, W., Felix, J., & Hakimian, P. (2011) · 2011 Ninth Annual International Conference on Privacy, Security and Trust · doi:10.1109/pst.2011.5971980 · Cited by 267
Flow-based network traffic generation using Generative Adversarial Networks
Ring, M., Schlör, D., Landes, D., & Hotho, A. (2019) · Computers & Security · doi:10.1016/j.cose.2018.12.012 · Cited by 239
Self-citationThe devil and packet trace anonymization
Pang, R., Allman, M., Paxson, V., & Lee, J. (2006) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1111322.1111330 · Cited by 223
Network traffic anomaly detection based on packet bytes
Mahoney, M. V. (2003) · Proceedings of the 2003 ACM symposium on Applied computing · doi:10.1145/952532.952601 · Cited by 219
Intrusion detection in computer networks by a modular ensemble of one-class classifiers
Giacinto, G., Perdisci, R., Del Rio, M., & Roli, F. (2008) · Information Fusion · doi:10.1016/j.inffus.2006.10.002 · Cited by 218
UGR‘16: A new dataset for the evaluation of cyclostationarity-based network IDSs
Maciá-Fernández, G., Camacho, J., Magán-Carrión, R., García-Teodoro, P., & Therón, R. (2018) · Computers & Security · doi:10.1016/j.cose.2017.11.004 · Cited by 213
From intrusion detection to attacker attribution: A comprehensive survey of unsupervised methods
Nisioti, A., Mylonas, A., Yoo, P. D., & Katos, V. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2854724 · Cited by 212
A first look at modern enterprise traffic
Pang, R., Allman, M. C., Bennett, M., Lee, J., Paxson, V., & Tierney, B. (2005) · ACM Internet Measurement Conference (IMC) · doi:10.1145/1330107.1330110 · Cited by 211
Generating realistic intrusion detection system dataset based on fuzzy qualitative modeling
Haider, W., Hu, J., Slay, J., Turnbull, B. P., & Xie, Y. (2017) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2017.03.018 · Cited by 205
Proceedings - IEEE Military Communications Conference MILCOM
Borkotoky, S. S., & Pursley, M. B. (2011) · Cited by 199
GT: picking up the truth from the ground for internet traffic
Gringoli, F., Salgarelli, L., Dusi, M., Cascarano, N., Risso, F., & claffy, K. C. (2009) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1629607.1629610 · Cited by 192
Detecting Distributed Denial of Service Attacks Using Data Mining Techniques
Alkasassbeh, M., Al-Naymat, G., B.A, A., & Almseidin, M. (2016) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2016.070159 · Cited by 192
Anwar, S., Mohamad Zain, J., Zolkipli, M. F., Inayat, Z., Khan, S., Anthony, B., & Chang, V. (2017) · Algorithms · doi:10.3390/a10020039 · Cited by 190
A Survey of Intrusion Detection Systems Leveraging Host Data
Bridges, R. A., Glass-Vanderlan, T. R., Iannacone, M. D., Vincent, M. S., & Chen, Q. (2019) · ACM Computing Surveys · doi:10.1145/3344382 · Cited by 176
Cyber security data sources for dynamic network research
Kent, A. D. (2016) · Security Science and Technology · doi:10.1142/9781786340757_0002 · Cited by 163
Toward a reliable anomaly-based intrusion detection in real-world environments
Viegas, E. K., Santin, A. O., & Oliveira, L. S. (2017) · Computer Networks · doi:10.1016/j.comnet.2017.08.013 · Cited by 159
A Labeled Data Set for Flow-Based Intrusion Detection
Sperotto, A., Sadre, R., van Vliet, F., & Pras, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04968-2_4 · Cited by 155
A review on cyber security datasets for machine learning algorithms
Ozlem, Y., & Aydos, M. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258167 · Cited by 140
Packet and Flow Based Network Intrusion Dataset
Gogoi, P., Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2012) · Communications in computer and information science · doi:10.1007/978-3-642-32129-0_34 · Cited by 132
Unified Host and Network Data Set
Turcotte, M., Kent, A. D., & Hash, C. (2018) · Security science and technology · doi:10.1142/9781786345646_001 · Cited by 114
Toward instrumenting network warfare competitions to generate labeled datasets
Sangster, B., OConnor, T., Cook, T. D., Fanelli, R. L., Dean, E., Adams, W. J., Morrell, C. C., & Conti, G. (2009) · Cited by 109
Towards Generating Real-life Datasets for Network Intrusion Detection.
Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2015) · International journal of network security · Cited by 109
Botnet Detection Based on Anomaly and Community Detection
Wang, J., & Paschalidis, I. C. (2016) · IEEE Transactions on Control of Network Systems · doi:10.1109/tcns.2016.2532804 · Cited by 108
An enhancing framework for botnet detection using generative adversarial networks
Yin, C., Zhu, Y., Liu, S., Fei, J., & Zhang, H. (2018) · International Conference on Artificial Intelligence and Big Data (ICAIBD) · doi:10.1109/icaibd.2018.8396200 · Cited by 102
On the Validation of Traffic Classification Algorithms
Szabó, G., Orincsay, D., Malomsoky, S., & Szabó, I. (2008) · Springer eBooks · doi:10.1007/978-3-540-79232-1_8 · Cited by 94
Connectionless Port Scan Detection on the Backbone
Sridharan, A., Ye, T., & Bhattacharyya, S. (2006) · IEEE International Performance, Computing, and Communications Conference · doi:10.1109/.2006.1629454 · Cited by 80
Benchmarking the Effect of Flow Exporters and Protocol Filters on Botnet Traffic Classification
Haddadi, F., & Zincir-Heywood, N. (2014) · IEEE Systems Journal · doi:10.1109/jsyst.2014.2364743 · Cited by 75
SSENet-2011: A Network Intrusion Detection System dataset and its comparison with KDD CUP 99 dataset
Vasudevan, A. R., Harshini, E., & Selvakumar, S. (2011) · Asian Himalayas International Conference on Internet · doi:10.1109/ahici.2011.6113948 · Cited by 58
Challenges in experimenting with botnet detection systems
Aviv, A. J., & Haeberlen, A. (2011) · ScholarlyCommons (University of Pennsylvania) · Cited by 58
Detection of slow port scans in flow-based network traffic
Ring, M., Landes, D., & Andreas Hotho, A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204507 · Cited by 58
Self-citationAn analysis of network traffic classification for botnet detection
Stevanovic, M., & Pedersen, J. M. (2015) · International Conference on Cyber Situational Awareness, Data Analytics and Assessment (CyberSA) · doi:10.1109/cybersa.2015.7361120 · Cited by 52
Fontugne, R., Borgnat, P., Abry, P., & Fukuda, K. (2010) · Cited by 46
Comprehensive, Multi-Source Cyber-Security Events Data Set
Kent, A. D. (2015) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.17021/1179829 · Cited by 45
A critical evaluation of datasets for investigating IDSs and IPSs researches
Nehinbe, J. (2011) · International Conference on Computational Intelligence and Security · doi:10.1109/cis.2011.6169141 · Cited by 45
A survey of state-of-the-art in anonymity metrics
Kelly, D. J., Raines, R. A., Grimaila, M. R., Baldwin, R. O., & Mullins, B. E. (2008) · doi:10.1145/1456441.1456453 · Cited by 36
(2018) · IEEE Intelligent Systems · doi:10.1109/mis.2018.022441342 · Cited by 34
Towards the creation of synthetic, yet realistic, intrusion detection datasets
Vasilomanolakis, E., Cordero, C. G., Milanov, N., & Mühlhäuser, M. (2016) · IEEE/IFIP Network Operations and Management Symposium (NOMS) · doi:10.1109/noms.2016.7502989 · Cited by 30
Behavior-based intrusion detection in encrypted environments
Koch, R. A., Golling, M., & Rodosek, G. D. (2014) · IEEE Communications Magazine · doi:10.1109/mcom.2014.6852093 · Cited by 29
Salting public traces with attack traffic to test flow classifiers
Celik, Z. B., Raghuram, J., Kesidis, G., & Miller, D. J. (2011) · Cited by 29
A new Attack Composition for Network Security
Beer, F., Hofer, T., Karimi, D., & Buehler, U. (2017) · DFN-Forum Kommunikationstechnologien · Cited by 29
Automatic Dataset Labelling and Feature Selection for Intrusion Detection Systems
Aparicio‐Navarro, F. J., Kyriakopoulos, K. G., & Parish, D. J. (2014) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2014.17 · Cited by 21
A Toolset for Intrusion and Insider Threat Detection
Ring, M., Wunderlich, S., Grüdl, D., Landes, D., & Andreas Hotho, A. (2017) · Data analytics · doi:10.1007/978-3-319-59439-2_1 · Cited by 19
Self-citationA Survey of Intrusion Detection Systems Leveraging Host DataPreprint
Glass-Vanderlan, T. R., Iannacone, M. D., Vincent, M. S., Qian, Q., Chen, & Bridges, R. A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.06070 · Cited by 19
Flow-Based Compromise Detection: Lessons Learned
Hofstede, R., Pras, A., Sperotto, A., et al. (2018) · IEEE Security & Privacy · doi:10.1109/msp.2018.1331021 · Cited by 18
CAMNEP: An intrusion detection system for highspeed networks
Řehák, M., Pěchouček, M., Bartoš, K., Grill, M., Čeleda, P., & Krmíček, V. (2008) · Progress in Informatics · doi:10.2201/niipi.2008.5.7 · Cited by 17
SSENet-2014 Dataset: A Dataset for Detection of Multiconnection Attacks
Bhattacharya, S., & Selvakumar, S. (2014) · International Conference on Eco-friendly Computing and Communication Systems (ICECCS) · doi:10.1109/eco-friendly.2014.100 · Cited by 17
Erlacher, F., & Dressler, F. (2018) · doi:10.1145/3229598.3229601 · Cited by 16
A flow trace generator using graph-based traffic classification techniques
Siska, P., Stoecklin, M. P., Kind, A., & Braun, T. I. (2010) · International Wireless Communications and Mobile Computing Conference (IWCMC) · doi:10.1145/1815396.1815503 · Cited by 15
A Reference Dataset for Network Traffic Activity Based Intrusion Detection System
Singh, R., Kumar, H., & Singla, R. K. (2015) · International Journal of Computers Communications & Control · doi:10.15837/ijccc.2015.3.1924 · Cited by 15
Towards Provable Network Traffic Measurement and Analysis via Semi-Labeled Trace Datasets
Čermák, M., Jirsík, T., Velan, P., Komárková, J., Špaček, S., Drašar, M., & Plesník, T. (2018) · Network Traffic Measurement and Analysis Conference (TMA) · doi:10.23919/tma.2018.8506498 · Cited by 10
SSENet-2014 Dataset: A Dataset for Detection of Multiconnection Attacks
Bhattacharya, S., & Selvakumar, S. (2014) · International Conference on Engineering of Complex Computer Systems · doi:10.1109/iceccs.2014.100 · Cited by 8
Cited by
Deep learning for cyber security intrusion detection: Approaches, datasets, and comparative study
Ferrag, M. A., Maglaras, L., Moschoyiannis, S., & Janicke, H. (2020) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2019.102419 · Cited by 1,130
Moustafa, N. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.102994 · Cited by 721
InSDN: A Novel SDN Intrusion Dataset
Elsayed, M. S., Le-Khac, N.-A., & Jurcut, A. D. (2020) · IEEE Access · doi:10.1109/access.2020.3022633 · Cited by 414
Towards a Standard Feature Set for Network Intrusion Detection System Datasets
Sarhan, M., Layeghy, S., & Portmann, M. (2022) · Mobile Networks and Applications · doi:10.1007/s11036-021-01843-0 · Cited by 405
NetFlow Datasets for Machine Learning-Based Network Intrusion Detection Systems
Sarhan, M., Layeghy, S., Moustafa, N., & Portmann, M. (2021) · Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering · doi:10.1007/978-3-030-72802-1_9 · Cited by 403
Metadata
- Authors
- Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A.
- Venue
- Computers & Security
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 86
- Pages
- 147-167
- ISSN
- 0167-4048 (ISSN-L)
- OpenAlex
- W2924689635
- Cited by
- 947
- References
- 83
- FWCI
- 49.85
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.