A new distributed architecture for evaluating AI-based security systems at the edge: Network TON_IoT datasets
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
While there has been a significant interest in understanding the cyber threat landscape of Internet of Things (IoT) networks, and the design of Artificial Intelligence (AI)-based security approaches, there is a lack of distributed architecture led to generating heterogeneous datasets that contain the actual behaviours of real-world IoT networks and complex cyber threat scenarios to evaluate the credibility of the new systems. This paper presents a new realistic testbed architecture of IoT network deployed at the IoT lab of the University of New South Wales (UNSW) at Canberra. The platform NSX vCloud NFV was employed to facilitate the execution of Software-Defined Network (SDN), Network Function Virtualization (NFV) and Service Orchestration (SO) to offer dynamic testbed networks, which allow the interaction of edge, fog and cloud tiers. While deploying the architecture, real-world normal and attack scenarios are executed to collect labeled datasets. The datasets are referred to as “ToN_IoT”, as they comprise heterogeneous data sources collected from telemetry datasets of IoT services, Windows and Linux-based datasets, and datasets of network traffic. The ToN_IoT network dataset is validated using four machine learning-based anomaly detection algorithms of Gradient Boosting Machine, Random Forest, Naive Bayes, and Deep Neural Networks, revealing a high performance of detection accuracy using the set of training and testing. These new datasets provide a realistic testbed of design, a variety of normal and attack events, heterogeneous data sources, and a ground truth table of security events. A comparative summary of the ToN_IoT network dataset and other competing network datasets demonstrates its diverse legitimate and anomalous patterns that can be used to better validate new AI-based security solutions. The datasets can be publicly accessed from ADFA (2020) .
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization
Sharafaldin, I., Habibi Lashkari, A., & Ghorbani, A. A. (2018) · Proceedings of the 4th International Conference on Information Systems Security and Privacy · doi:10.5220/0006639801080116 · Cited by 5,318
Moustafa, N., & Slay, J. (2015) · 2015 Military Communications and Information Systems Conference (MilCIS) · doi:10.1109/milcis.2015.7348942 · Cited by 4,033
Self-citationKoroniotis, N., Moustafa, N., Sitnikova, E., & Turnbull, B. (2019) · Future Generation Computer Systems · doi:10.1016/j.future.2019.05.041 · Cited by 1,983
Self-citationSilva, B. N., Khan, M., & Han, K. (2018) · Sustainable Cities and Society · doi:10.1016/j.scs.2018.01.053 · Cited by 1,668
N-BaIoT—Network-Based Detection of IoT Botnet Attacks Using Deep Autoencoders
Meidan, Y., Bohadana, M., Mathov, Y., Mirsky, Y., Shabtai, A., Breitenbacher, D., & Elovici, Y. (2018) · IEEE Pervasive Computing · doi:10.1109/mprv.2018.03367731 · Cited by 1,483
Toward developing a systematic approach to generate benchmark datasets for intrusion detection
Shiravi, A., Shiravi, H., Tavallaee, M., & Ghorbani, A. A. (2012) · Computers & Security · doi:10.1016/j.cose.2011.12.012 · Cited by 1,345
Developing Realistic Distributed Denial of Service (DDoS) Attack Dataset and Taxonomy
Sharafaldin, I., Lashkari, A. H., Hakak, S., & Ghorbani, A. A. (2019) · 2019 International Carnahan Conference on Security Technology (ICCST) · doi:10.1109/ccst.2019.8888419 · Cited by 1,275
Scanning the Industry 4.0: A Literature Review on Technologies for Manufacturing Systems
Alcácer, V., & Cruz-Machado, V. (2019) · Engineering Science and Technology, an International Journal · doi:10.1016/j.jestch.2019.01.006 · Cited by 1,063
A survey of network-based intrusion detection data sets
Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A. (2019) · Computers & Security · doi:10.1016/j.cose.2019.06.005 · Cited by 947
Random Forest Modeling for Network Intrusion Detection System
Farnaaz, N., & Jabbar, M. A. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.06.047 · Cited by 684
Enabling technologies and sustainable smart cities
Ahad, M. A., Paiva, S., Tripathi, G., & Feroz, N. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102301 · Cited by 602
Sequence-to-Sequence Prediction of Vehicle Trajectory via LSTM Encoder-Decoder Architecture
Park, S. H., Kim, B., Kang, C. M., Chung, C. C., & Choi, J. W. (2018) · 2018 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2018.8500658 · Cited by 504
Intrusion Detection using Naive Bayes Classifier with Feature Reduction
Mukherjee, S., & Sharma, N. (2012) · Procedia Technology · doi:10.1016/j.protcy.2012.05.017 · Cited by 473
Resource Management in Fog/Edge Computing: A Survey on Architectures, Infrastructure, and Algorithms
Hong, C.-H., & Varghese, B. (2020) · ACM Computing Surveys · doi:10.1145/3326066 · Cited by 461
Dizdarević, J., Carpio, F., Jukan, A., & Masip Bruin, X. (2019) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · Cited by 433
Dizdarević, J., Carpio, F., Jukan, A., & Masip-Bruin, X. (2019) · ACM Computing Surveys · doi:10.1145/3292674 · Cited by 423
2018 IEEE Intelligent Vehicles Symposium (IV)
(2018) · doi:10.1109/iv43497.2018 · Cited by 422
How Generative Adversarial Networks and Their Variants Work: An Overview
Hong, Y., Hwang, U., Yoo, J., & Yoon, S. (2020) · ACM Computing Surveys · doi:10.1145/3301282 · Cited by 373
An Intrusion Detection System Using a Deep Neural Network With Gated Recurrent Units
Xu, C., Shen, J., Du, X., & Zhang, F. (2018) · IEEE Access · doi:10.1109/access.2018.2867564 · Cited by 339
A holistic review of Network Anomaly Detection Systems: A comprehensive survey
Moustafa, N., Hu, J., & Slay, J. (2019) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2018.12.006 · Cited by 317
Self-citationA blockchain enabled Cyber-Physical System architecture for Industry 4.0 manufacturing systems
Lee, J., Azamfar, M., & Singh, J. (2019) · Manufacturing Letters · doi:10.1016/j.mfglet.2019.05.003 · Cited by 265
Scalable machine learning-based intrusion detection system for IoT-enabled smart cities
Rahman, M. A., Asyhari, A. T., Leong, L. S., Satrya, G. B., Hai Tao, M., & Zolkipli, M. F. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102324 · Cited by 219
Li, D., Deng, L., Lee, M., & Wang, H. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.04.006 · Cited by 212
A New Threat Intelligence Scheme for Safeguarding Industry 4.0 Systems
Moustafa, N., Adi, E., Turnbull, B., & Hu, J. (2018) · IEEE Access · doi:10.1109/access.2018.2844794 · Cited by 153
Self-citationO’Donovan, P., Gallagher, C., Bruton, K., & O’Sullivan, D. T. J. (2018) · Manufacturing Letters · doi:10.1016/j.mfglet.2018.01.005 · Cited by 140
Packet and Flow Based Network Intrusion Dataset
Gogoi, P., Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2012) · Communications in computer and information science · doi:10.1007/978-3-642-32129-0_34 · Cited by 132
Federated TON_IoT Windows Datasets for Evaluating AI-Based Security Applications
Moustafa, N., Keshky, M., Debiez, E., & Janicke, H. (2020) · 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom50675.2020.00114 · Cited by 129
Self-citationTowards Generating Real-life Datasets for Network Intrusion Detection.
Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2015) · International journal of network security · Cited by 109
Data Analytics-Enabled Intrusion Detection: Evaluations of ToN_IoT Linux Datasets
Moustafa, N., Ahmed, M., & Ahmed, S. (2020) · 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom50675.2020.00100 · Cited by 90
Self-citationNetwork Intrusion Detection Using Clustering and Gradient Boosting
Verma, P., Anwar, S., Khan, S., & Mane, S. B. (2018) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt.2018.8494186 · Cited by 72
2019 IEEE Vehicular Networking Conference (VNC)
(2019) · doi:10.1109/vnc48660.2019 · Cited by 71
A Survey of Communication Performance Models for High-Performance Computing
Rico‐Gallego, J., Martín, J. C. D., Manumachu, R. R., & Lastovetsky, A. (2019) · ACM Computing Surveys · doi:10.1145/3284358 · Cited by 57
Integrating Wireless Sensor Network into Cloud services for real-time data collection
Piyare, R., Park, S., Maeng, S. Y., Park, S. H., Oh, S. C., Choi, S. G., Choi, H. S., & Lee, S. R. (2013) · International Conference on Information and Communication Technology Convergence (ICTC) · doi:10.1109/ictc.2013.6675470 · Cited by 42
Fog-Orchestrated and Server-Controlled Anonymous Group Authentication and Key Agreement
Shabisha, P., Braeken, A., Kumar, P., & Steenhaut, K. (2019) · IEEE Access · doi:10.1109/access.2019.2946713 · Cited by 16
Intrusion Detection Using ASTDs
Tidjon, L. N., Frappier, M., & Mammar, A. (2020) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-44041-1_118 · Cited by 15
Raca, D., Sani, Y., Sreenan, C. J., & Quinlan, J. J. (2019) · ACM Multimedia Systems Conference (MMSys) · doi:10.1145/3304109.3325813 · Cited by 7
Cited by
Abdullahi, M., Baashar, Y., Alhussian, H., Alwadain, A., Aziz, N., Capretz, L. F., & Abdulkadir, S. J. (2022) · Electronics · doi:10.3390/electronics11020198 · Cited by 361
Ferrag, M. A., Friha, O., Maglaras, L., Janicke, H., & Shu, L. (2021) · IEEE Access · doi:10.1109/access.2021.3118642 · Cited by 342
“This dataset is introduced by the IoT Lab of the UNSW Canberra Cyber, the School of Engineering and Information technology (SEIT), UNSW Canberra at the Australian Defence Force Academy (ADFA) [150] for the collection and analysis of mixed data sources from IoT and Industrial IoT (IIoT).”
Disha, R. A., & Waheed, S. (2022) · Cybersecurity · doi:10.1186/s42400-021-00103-8 · Cited by 334
Moustafa, N., Koroniotis, N., Keshk, M., Zomaya, A. Y., & Tari, Z. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3280465 · Cited by 266
Self-citationAn explainable deep learning-enabled intrusion detection framework in IoT networks
Keshk, M., Koroniotis, N., Pham, N., Moustafa, N., Turnbull, B., & Zomaya, A. Y. (2023) · Information Sciences · doi:10.1016/j.ins.2023.119000 · Cited by 261
Self-citation
Metadata
- Authors
- Moustafa, N.
- Venue
- Sustainable Cities and Society
- Publisher
- Elsevier BV
- Published
- 2021-09
- Volume
- 72
- Pages
- 102994
- ISSN
- 2210-6707 (ISSN-L)
- OpenAlex
- W3162956350
- Cited by
- 721
- References
- 40
- FWCI
- 36.86
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.