The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Outside the Closed World: On Using Machine Learning for Network Intrusion Detection
Abstract
In network intrusion detection research, one popular strategy for finding attacks is monitoring a network's activity for anomalies: deviations from profiles of normality previously learned from benign traffic, typically identified using tools borrowed from the machine learning community. However, despite extensive academic research one finds a striking gap in terms of actual deployments of such systems: compared with other intrusion detection approaches, machine learning is rarely employed in operational "real world" settings. We examine the differences between the network intrusion detection problem and other areas where machine learning regularly finds much more success. Our main claim is that the task of finding attacks is fundamentally different from these other applications, making it significantly harder for the intrusion detection community to employ machine learning effectively. We support this claim by identifying challenges particular to network intrusion detection, and provide a set of guidelines meant to strengthen future research on anomaly detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Witten, I. H. (2008) · Cited by 9,143
Amazon.com recommendations: item-to-item collaborative filtering
Linden, G., Smith, B., & York, J. (2003) · IEEE Internet Computing · doi:10.1109/mic.2003.1167344 · Cited by 5,403
Abe, S. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0285-4 · Cited by 3,721
Denning, D. E. (1987) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1987.232894 · Cited by 3,427
Bro: a system for detecting network intruders in real-time
Paxson, V. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00112-7 · Cited by 2,636
Self-citationAn Overview of the Tesseract OCR Engine
Smith, R. (2007) · Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) Vol 2 · doi:10.1109/icdar.2007.4376991 · Cited by 2,376
Robust De-anonymization of Large Sparse Datasets
Narayanan, A., & Shmatikov, V. (2008) · 2008 IEEE Symposium on Security and Privacy (sp 2008) · doi:10.1109/sp.2008.33 · Cited by 2,372
Pattern Classification (2nd Edition)
Duda, R. O., Hart, P. E., & Stork, D. G. (2000) · Wiley-Interscience eBooks · Cited by 2,070
Cited by
Drebin: Effective and Explainable Detection of Android Malware in Your Pocket
Arp, D., Spreitzenbarth, M., Hübner, M., Gascon, H., & Rieck, K. (2014) · Proceedings 2014 Network and Distributed System Security Symposium · doi:10.14722/ndss.2014.23247 · Cited by 2,331
Toward developing a systematic approach to generate benchmark datasets for intrusion detection
Shiravi, A., Shiravi, H., Tavallaee, M., & Ghorbani, A. A. (2012) · Computers & Security · doi:10.1016/j.cose.2011.12.012 · Cited by 1,345
Huang, L., Joseph, A. D., Nelson, B., Rubinstein, B. I. P., & Tygar, J. D. (2011) · Proceedings of the 4th ACM workshop on Security and artificial intelligence · doi:10.1145/2046684.2046692 · Cited by 1,194
Boutaba, R., Salahuddin, M. A., Limam, N., Ayoubi, S., Shahriar, N., Estrada-Solano, F., & Caicedo, O. M. (2018) · Journal of Internet Services and Applications · doi:10.1186/s13174-018-0087-2 · Cited by 1,036
A survey of network-based intrusion detection data sets
Ring, M., Wunderlich, S., Scheuring, D., Landes, D., & Hotho, A. (2019) · Computers & Security · doi:10.1016/j.cose.2019.06.005 · Cited by 947
Network Intrusion Detection for IoT Security Based on Learning Techniques
Chaabouni, N., Mosbah, M., Zemmari, A., Sauvignac, C., & Faruki, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2896380 · Cited by 940
Deep learning approach for Network Intrusion Detection in Software Defined Networking
Tang, T. A., Mhamdi, L., McLernon, D., Zaidi, S. A. R., & Ghogho, M. (2016) · 2016 International Conference on Wireless Networks and Mobile Communications (WINCOM) · doi:10.1109/wincom.2016.7777224 · Cited by 806
A survey of intrusion detection techniques for cyber-physical systems
Mitchell, R., & Chen, I.-R. (2014) · ACM Computing Surveys · doi:10.1145/2542049 · Cited by 768
DÏoT: A Federated Self-learning Anomaly Detection System for IoT
Nguyen, T. D., Marchal, S., Miettinen, M., Fereidooni, H., Asokan, N., & Sadeghi, A.-R. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00080 · Cited by 663
Unsupervised Machine Learning for Networking: Techniques, Applications and Research Challenges
Usama, M., Qadir, J., Raza, A., Arif, H., Yau, K.-L. A., Elkhatib, Y., Hussain, A., & Al-Fuqaha, A. (2019) · IEEE Access · doi:10.1109/access.2019.2916648 · Cited by 575
Adversarial Examples for Malware Detection
Grosse, K., Papernot, N., Manoharan, P., Backes, M., & McDaniel, P. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66399-9_4 · Cited by 542
A Survey on Machine Learning Techniques for Cyber Security in the Last Decade
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I. A., & Xu, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041951 · Cited by 530
Adversarial Machine Learning for Network Intrusion Detection Systems: A Comprehensive Survey
He, K., Kim, D. D., & Asghar, M. R. (2023) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2022.3233793 · Cited by 450
An experimental analysis of attack classification using machine learning in IoT networks
Churcher, A., Ullah, R., Ahmad, J., ur Rehman, S., Masood, F., Gogate, M., Alqahtani, F., Nour, B., & Buchanan, W. J. (2021) · Sensors · doi:10.3390/s21020446 · Cited by 439
Towards a Standard Feature Set for Network Intrusion Detection System Datasets
Sarhan, M., Layeghy, S., & Portmann, M. (2022) · Mobile Networks and Applications · doi:10.1007/s11036-021-01843-0 · Cited by 405
DDoS Attack Detection and Mitigation Using SDN: Methods, Practices, and Solutions
Bawany, N. Z., Shamsi, J. A., & Salah, K. (2017) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-017-2414-5 · Cited by 387
Deep learning methods in network intrusion detection: A survey and an objective comparison
Gamage, S., & Samarabandu, J. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2020.102767 · Cited by 382
A Survey of Random Forest Based Methods for Intrusion Detection Systems
Resende, P. A. A., & Drummond, A. C. (2019) · ACM Computing Surveys · doi:10.1145/3178582 · Cited by 368
Lucid: A Practical, Lightweight Deep Learning Solution for DDoS Attack Detection
Doriguzzi-Corin, R., Millar, S., Scott-Hayward, S., Martínez-del-Rincón, J., & Siracusa, D. (2020) · IEEE Transactions on Network and Service Management · doi:10.1109/tnsm.2020.2971776 · Cited by 364
IntruDTree: A Machine Learning Based Cyber Security Intrusion Detection Model
Sarker, I. H., Abushark, Y. B., Alsolami, F., & Khan, A. I. (2020) · Symmetry · doi:10.3390/sym12050754 · Cited by 356
Ghaffarian, S. M., & Shahriari, H. R. (2018) · ACM Computing Surveys · doi:10.1145/3092566 · Cited by 353
TSDL: A Two-Stage Deep Learning Model for Efficient Network Intrusion Detection
Khan, F. A., Gumaei, A., Derhab, A., & Hussain, A. (2019) · IEEE Access · doi:10.1109/access.2019.2899721 · Cited by 353
NoDoze: Combatting Threat Alert Fatigue with Automated Provenance Triage
Hassan, W. U., Guo, S., Li, D., Chen, Z., Jee, K., Li, Z., & Bates, A. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23349 · Cited by 341
An effective intrusion detection approach using SVM with naïve Bayes feature embedding
Gu, J., & Lu, S. (2021) · Computers & Security · doi:10.1016/j.cose.2020.102158 · Cited by 340
Prophiler: a fast filter for the large-scale detection of malicious web pages
Canali, D., Cova, M., Vigna, G., & Kruegel, C. (2011) · Proceedings of the 20th international conference on World wide web · doi:10.1145/1963405.1963436 · Cited by 335
Intrusion detection and Big Heterogeneous Data: a Survey
Zuech, R., Khoshgoftaar, T. M., & Wald, R. (2015) · Journal of Big Data · doi:10.1186/s40537-015-0013-4 · Cited by 326
Enterprise data breach: causes, challenges, prevention, and future directions
Cheng, L., Liu, F., & Yao, D. (. (2017) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1211 · Cited by 307
Deep Recurrent Neural Network for Intrusion Detection in SDN-based Networks
Tang, T. A., Mhamdi, L., McLernon, D., Zaidi, S. A. R., & Ghogho, M. (2018) · 2018 4th IEEE Conference on Network Softwarization and Workshops (NetSoft) · doi:10.1109/netsoft.2018.8460090 · Cited by 296
A survey of edge computing-based designs for IoT security
Sha, K., Yang, T. A., Wei, W., & Davari, S. (2020) · Digital Communications and Networks · doi:10.1016/j.dcan.2019.08.006 · Cited by 295
Anderson, B., & McGrew, D. (2017) · Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/3097983.3098163 · Cited by 295
DDoSNet: A Deep-Learning Model for Detecting Network Attacks
Elsayed, M. S., Le-Khac, N.-A., Dev, S., & Jurcut, A. D. (2020) · 2020 IEEE 21st International Symposium on "A World of Wireless, Mobile and Multimedia Networks" (WoWMoM) · doi:10.1109/wowmom49955.2020.00072 · Cited by 295
Identifying Encrypted Malware Traffic with Contextual Flow Data
Anderson, B., & McGrew, D. (2016) · Proceedings of the 2016 ACM Workshop on Artificial Intelligence and Security · doi:10.1145/2996758.2996768 · Cited by 261
Identification of personal traits in adaptive learning environment: Systematic literature review
Afini Normadhi, N. B., Shuib, L., Md Nasir, H. N., Bimba, A., Idris, N., & Balakrishnan, V. (2019) · Computers & Education · doi:10.1016/j.compedu.2018.11.005 · Cited by 204
Unsolved Problems in ML Safety
Hendrycks, D., Carlini, N., Schulman, J., & Steinhardt, J. (2021) · arXiv · doi:10.48550/arxiv.2109.13916 · Cited by 95
How Machine Learning is Changing e-Government
Alexopoulos, C., Lachana, Z., Androutsopoulou, A., Diamantopoulou, V., Charalabidis, Y., & Loutsaris, M. A. (2019) · Proceedings of the 12th International Conference on Theory and Practice of Electronic Governance · doi:10.1145/3326365.3326412 · Cited by 88
On the Detection of Disinformation Campaign Activity with Network Analysis
Vargas, L., Emami, P., & Traynor, P. (2020) · Proceedings of the 2020 ACM SIGSAC Conference on Cloud Computing Security Workshop · doi:10.1145/3411495.3421363 · Cited by 74
Hunting for Insider Threats Using LSTM-Based Anomaly Detection
Villarreal-Vasquez, M., Modelo-Howard, G., Dube, S., & Bhargava, B. (2023) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3135639 · Cited by 52
Kus, D., Wagner, E., Pennekamp, J., Wolsing, K., Fink, I. B., Dahlmanns, M., Wehrle, K., & Henze, M. (2022) · Proceedings of the 8th ACM on Cyber-Physical System Security Workshop · doi:10.1145/3494107.3522773 · Cited by 28
Uche James, U., Idika, C. N., & Anebi Enyejo, L. (2023) · International Journal of Scientific Research in Computer Science, Engineering and Information Technology · doi:10.32628/cseit23564522 · Cited by 29
LLMs in Cyber Security: Bridging Practice and Education
Atlam, H. F. (2025) · Big Data and Cognitive Computing · doi:10.3390/bdcc9070184 · Cited by 27
Smart Congestion Control for Delay- and Disruption Tolerant Networks
Silva, A. P., Obraczka, K., Burleigh, S., & Hirata, C. M. (2016) · 2016 13th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) · doi:10.1109/sahcn.2016.7733018 · Cited by 20
Anomaly Detection and Enterprise Security using User and Entity Behavior Analytics (UEBA)
Zunair Ahmed Khan, M., Mubashir Khan, M., & Arshad, J. (2022) · 2022 3rd International Conference on Innovations in Computer Science & Software Engineering (ICONICS) · doi:10.1109/iconics56716.2022.10100596 · Cited by 19
Explainable AI in Cybersecurity Operations: Lessons Learned from xAI Tool Deployment
Nyre-Yu, M., Morris, E., Smith, M., Moss, B., & Smutz, C. (2022) · Proceedings 2022 Symposium on Usable Security · doi:10.14722/usec.2022.23014 · Cited by 15
Decision Tree-Based Rule Derivation for Intrusion Detection in Safety-Critical Automotive Systems
Buschlinger, L., Rieke, R., Sarda, S., & Kraus, C. (2022) · 2022 30th Euromicro International Conference on Parallel, Distributed and Network-based Processing (PDP) · doi:10.1109/pdp55904.2022.00046 · Cited by 14
A Novel Framework for Enhancing Decision-Making in Autonomous Cyber Defense Through Graph Embedding
Wang, Z., Wang, Y., Xiong, X., Ren, Q., & Huang, J. (2025) · Entropy · doi:10.3390/e27060622 · Cited by 7
Ismailov, M., Tsikerdekis, M., & Zeadally, S. (2020) · Future Internet · doi:10.3390/fi12090148 · Cited by 6
Bringing Machine Learning Classifiers Into Critical Cyber-Physical Systems: A Matter of Design
Sayin, B., Zoppi, T., Marchini, N., Khokhar, F. A., & Passerini, A. (2025) · IEEE Access · doi:10.1109/access.2025.3568501 · Cited by 7
“Restrictions apply. test set may contain data that is different from the training set but belongs to the same distribution: this is the closed world assumption, which demands Independent and Identi-cally Distributed (IID) data [7].”
(2019) · Cited by 3
Metadata
- Authors
- Sommer, R., & Paxson, V.
- Venue
- 2010 IEEE Symposium on Security and Privacy
- Publisher
- IEEE
- Published
- 2010
- Pages
- 305-316
- ISSN
- 1081-6011 (ISSN-L)
- OpenAlex
- W1985987493
- Cited by
- 2,085
- References
- 52
- FWCI
- 40.77
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.