The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Towards a Reliable Intrusion Detection Benchmark Dataset
Open accessAbstract
The urgently growing number of security threats on Internet and intranet networks highly demands reliable security solutions.Among various options, Intrusion Detection (IDSs) and Intrusion Prevention Systems (IPSs) are used to defend network infrastructure by detecting and preventing attacks and malicious activities.The performance of a detection system is evaluated using benchmark datasets.There exist a number of datasets, such as DARPA98, KDD99, ISC2012, and ADFA13, that have been used by researchers to evaluate the performance of their intrusion detection and prevention approaches.However, not enough research has focused on the evaluation and assessment of the datasets themselves and there is no reliable dataset in this domain.In this paper, we present a comprehensive evaluation of the existing datasets using our proposed criteria, a design and evaluation framework for IDS and IPS datasets, and a dataset generation model to create a reliable IDS or IPS benchmark dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Self-citationX-means: Extending K-means with Efficient Estimation of the Number of Clusters
Pelleg, D., & Moore, A. (2000) · Cited by 2,245
Toward developing a systematic approach to generate benchmark datasets for intrusion detection
Shiravi, A., Shiravi, H., Tavallaee, M., & Ghorbani, A. A. (2012) · Computers & Security · doi:10.1016/j.cose.2011.12.012 · Cited by 1,345
Self-citationMcHugh, J. (2000) · ACM Transactions on Information and System Security · doi:10.1145/382912.382923 · Cited by 1,309
CID: an efficient complexity-invariant distance for time series
Batista, G. E. A. P. A., Keogh, E. J., Tataw, O. M., & de Souza, V. M. A. (2014) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-013-0312-3 · Cited by 359
Statistical analysis of honeypot data and building of Kyoto 2006+ dataset for NIDS evaluation
Song, J., Takakura, H., Okabe, Y., Eto, M., Inoue, D., & Nakao, K. (2011) · Proceedings of the First Workshop on Building Analysis Datasets and Gathering Experience Returns for Security · doi:10.1145/1978672.1978676 · Cited by 334
Generation of a new IDS test dataset: Time to retire the KDD collection
Creech, G., & Hu, J. (2013) · 2013 IEEE Wireless Communications and Networking Conference (WCNC) · doi:10.1109/wcnc.2013.6555301 · Cited by 320
A Labeled Data Set for Flow-Based Intrusion Detection
Sperotto, A., Sadre, R., van Vliet, F., & Pras, A. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04968-2_4 · Cited by 155
Toward instrumenting network warfare competitions to generate labeled datasets
Sangster, B., OConnor, T., Cook, T. D., Fanelli, R. L., Dean, E., Adams, W. J., Morrell, C. C., & Conti, G. (2009) · Cited by 109
Analysis of the 1999 DARPA/Lincoln Laboratory IDS evaluation data with NetADHICT
Brown, C. D., Cowperthwaite, A., Hijazi, A., & Somayaji, A. B. (2009) · IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA) · doi:10.1109/cisda.2009.5356522 · Cited by 72
Cited by
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
“Finally, we evaluate the quality of the generated dataset by searching for common mistakes and criticisms of other synthetically created datasets, based on the 11 criteria from the last proposed dataset evaluation framework by Canadian Institute for Cybersecurity (CIC)(Sharafaldin et al., 2017).”
MethodInfluentialSelf-citationDeveloping Realistic Distributed Denial of Service (DDoS) Attack Dataset and Taxonomy
Sharafaldin, I., Lashkari, A. H., Hakak, S., & Ghorbani, A. A. (2019) · 2019 International Carnahan Conference on Security Technology (ICCST) · doi:10.1109/ccst.2019.8888419 · Cited by 1,275
Self-citationA survey of network-based intrusion detection data sets
Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A. (2019) · Computers & Security · doi:10.1016/j.cose.2019.06.005 · Cited by 947
Maseer, Z. K., Yusof, R., Bahaman, N., Mostafa, S. A., & Foozy, C. F. M. (2021) · IEEE Access · doi:10.1109/access.2021.3056614 · Cited by 473
Asharf, J., Moustafa, N., Khurshid, H., Debie, E., Haider, W., & Wahab, A. (2020) · Electronics · doi:10.3390/electronics9071177 · Cited by 378
Metadata
- Authors
- Sharafaldin, I., Canadian Institute for Cybersecurity (CIC), U., Gharib, A., Canadian Institute for Cybersecurity (CIC), U., Lashkari, A. H., Canadian Institute for Cybersecurity (CIC), U., Ghorbani, A. A., & Canadian Institute for Cybersecurity (CIC), U.
- Venue
- Software Networking
- Publisher
- River Publishers
- Published
- 2017
- Volume
- 2017
- Issue
- 1
- Pages
- 177-200
- ISSN
- 2445-9739 (ISSN-L)
- OpenAlex
- W2732560875
- Cited by
- 302
- References
- 14
- FWCI
- 12.29
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Towards a Reliable Intrusion Detection Benchmark Dataset. https://app.cochat.ai/papers/10.13052/jsn2445-9739.2017.009
- The paper
- Sharafaldin, I., Canadian Institute for Cybersecurity (CIC), U., Gharib, A., Canadian Institute for Cybersecurity (CIC), U., Lashkari, A. H., Canadian Institute for Cybersecurity (CIC), U., Ghorbani, A. A., & Canadian Institute for Cybersecurity (CIC), U. (2017). Towards a Reliable Intrusion Detection Benchmark Dataset. Software Networking. https://doi.org/10.13052/jsn2445-9739.2017.009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.