The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Outside the Closed World: On Using Machine Learning for Network Intrusion Detection
Abstract
In network intrusion detection research, one popular strategy for finding attacks is monitoring a network's activity for anomalies: deviations from profiles of normality previously learned from benign traffic, typically identified using tools borrowed from the machine learning community. However, despite extensive academic research one finds a striking gap in terms of actual deployments of such systems: compared with other intrusion detection approaches, machine learning is rarely employed in operational "real world" settings. We examine the differences between the network intrusion detection problem and other areas where machine learning regularly finds much more success. Our main claim is that the task of finding attacks is fundamentally different from these other applications, making it significantly harder for the intrusion detection community to employ machine learning effectively. We support this claim by identifying challenges particular to network intrusion detection, and provide a set of guidelines meant to strengthen future research on anomaly detection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Witten, I. H. (2008) · Cited by 9,143
Amazon.com recommendations: item-to-item collaborative filtering
Linden, G., Smith, B., & York, J. (2003) · IEEE Internet Computing · doi:10.1109/mic.2003.1167344 · Cited by 5,403
Abe, S. (2001) · Springer eBooks · doi:10.1007/978-1-4471-0285-4 · Cited by 3,721
Denning, D. E. (1987) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1987.232894 · Cited by 3,427
Bro: a system for detecting network intruders in real-time
Paxson, V. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00112-7 · Cited by 2,636
Self-citationAn Overview of the Tesseract OCR Engine
Smith, R. (2007) · Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) Vol 2 · doi:10.1109/icdar.2007.4376991 · Cited by 2,376
Robust De-anonymization of Large Sparse Datasets
Narayanan, A., & Shmatikov, V. (2008) · 2008 IEEE Symposium on Security and Privacy (sp 2008) · doi:10.1109/sp.2008.33 · Cited by 2,372
Pattern Classification (2nd Edition)
Duda, R. O., Hart, P. E., & Stork, D. G. (2000) · Wiley-Interscience eBooks · Cited by 2,070
The Unreasonable Effectiveness of Data
Halevy, A., Norvig, P., & Pereira, F. (2009) · IEEE Intelligent Systems · doi:10.1109/mis.2009.36 · Cited by 1,767
Willinger, W., Taqqu, M. S., Sherman, R., & Wilson, D. V. (1997) · IEEE/ACM Transactions on Networking · doi:10.1109/90.554723 · Cited by 1,654
Statistical Fraud Detection: A Review
Bolton, R. J., & Hand, D. J. (2002) · Statistical Science · doi:10.1214/ss/1042727940 · Cited by 1,450
McHugh, J. (2000) · ACM Transactions on Information and System Security · doi:10.1145/382912.382923 · Cited by 1,309
Bennett, J. R., & Lanning, S. (2007) · Cited by 1,134
Musa, T. H. A., & Bouras, A. (2022) · Lecture Notes in Networks and Systems · doi:10.1007/978-981-16-2102-4_36 · Cited by 958
The Alignment Template Approach to Statistical Machine Translation
Och, F. J., & Ney, H. (2004) · Computational Linguistics · doi:10.1162/0891201042544884 · Cited by 918
The 1999 DARPA off-line intrusion detection evaluation
Lippmann, R., Haines, J. W., Fried, D. J., Korba, J., & Das, K. (2000) · Computer Networks · doi:10.1016/s1389-1286(00)00139-0 · Cited by 876
Youtube traffic characterization: a view from the edge
Gill, P., Arlitt, M., Li, Z., & Mahanti, A. (2007) · Proceedings of the 7th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1298306.1298310 · Cited by 852
Can machine learning be secure?
Barreno, M., Nelson, B., Sears, R., Joseph, A. D., & Tygar, J. D. (2006) · Proceedings of the 2006 ACM Symposium on Information, computer and communications security · doi:10.1145/1128817.1128824 · Cited by 836
Difficulties in simulating the Internet
Floyd, S., & Paxson, V. (2001) · IEEE/ACM Transactions on Networking · doi:10.1109/90.944338 · Cited by 721
Self-citationBotHunter: detecting malware infection through IDS-driven dialog correlation
Gu, G., Porras, P. A., Yegneswaran, V., Fong, M. W., & Lee, W. (2007) · Cited by 696
Insertion, Evasion, and Denial of Service: Eluding Network Intrusion Detection
Ptacek, T. H., & Newsham, T. N. (1998) · Cited by 649
Anomaly detection of web-based attacks
Kruegel, C., & Vigna, G. (2003) · Proceedings of the 10th ACM conference on Computer and communications security · doi:10.1145/948109.948144 · Cited by 551
OpenFst: A General and Efficient Weighted Finite-State Transducer Library
Allauzen, C., Riley, M., Schalkwyk, J., Skut, W., & Mohri, M. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-76336-9_3 · Cited by 539
Information-theoretic measures for anomaly detection
Lee, W., & Xiang, D. (2002) · Proceedings 2001 IEEE Symposium on Security and Privacy. S&P 2001 · doi:10.1109/secpri.2001.924294 · Cited by 537
An Analysis of the 1999 DARPA/Lincoln Laboratory Evaluation Data for Network Anomaly Detection
Mahoney, M. V., & Chan, P. K. (2003) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-45248-5_13 · Cited by 535
Data networks as cascades: investigating the multifractal nature of Internet WAN traffic
Feldmann, A., Gilbert, A. C., & Willinger, W. (1998) · Proceedings of the ACM SIGCOMM '98 conference on Applications, technologies, architectures, and protocols for computer communication · doi:10.1145/285237.285256 · Cited by 388
The base-rate fallacy and its implications for the difficulty of intrusion detection
Axelsson, S. (1999) · Proceedings of the 6th ACM conference on Computer and communications security · doi:10.1145/319709.319710 · Cited by 325
Ko, C., Ruschitzka, M., & Levitt, K. (2002) · Proceedings. 1997 IEEE Symposium on Security and Privacy (Cat. No.97CB36097) · doi:10.1109/secpri.1997.601332 · Cited by 318
Virtual Honeypots: From Botnet Tracking to Intrusion Detection
Provos, N., & Holz, T. (2007) · Cited by 311
An immunological model of distributed detection and its application to computer security
Forrest, S., & Hofmeyr, S. A. (1999) · Cited by 272
An application of machine learning to network intrusion detection
Sinclair, C., Pierce, L., & Matzner, S. (2003) · Proceedings 15th Annual Computer Security Applications Conference (ACSAC'99) · doi:10.1109/csac.1999.816048 · Cited by 271
Unveiling facebook: a measurement study of social network based applications
Nazir, A., Raza, S., & Chuah, C.-N. (2008) · Proceedings of the 8th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1452520.1452527 · Cited by 269
The NIDES Statistical Component Description and Justification
Javitz, H. S., & Valdes, A. (1994) · Cited by 252
Zhang, Z. (2001) · Cited by 229
Anomaly detection of web-based attacks
Kruegel, C., & Vigna, G. (2003) · doi:10.1145/948143.948144 · Cited by 225
The devil and packet trace anonymization
Pang, R., Allman, M., Paxson, V., & Lee, J. (2006) · ACM SIGCOMM Computer Communication Review · doi:10.1145/1111322.1111330 · Cited by 223
Self-citationDetecting Targeted Attacks Using Shadow Honeypots
Anagnostakis, K. G., Sidiroglou, S., Akritidis, P., Xinidis, K., Markatos, E. P., & Keromytis, A. D. (2005) · doi:10.7916/d8wm1ps8 · Cited by 195
Robust Support Vector Machines for Anomaly Detection in Computer Security.
Hu, W., Liao, Y., & Vemuri, V. R. (2003) · International Conference on Machine Learning and Applications · Cited by 186
Spamscatter: characterizing internet scam hosting infrastructure
Anderson, D. S., Fleizach, C., Savage, S., & Voelker, G. M. (2007) · eScholarship (California Digital Library) · Cited by 179
Evading network anomaly detection systems: formal reasoning and practical techniques
Fogla, P., & Lee, W. (2006) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/1180405.1180414 · Cited by 161
Strategies for sound internet measurement
Paxson, V. (2004) · ACM Internet Measurement Conference (IMC) · doi:10.1145/1028788.1028824 · Cited by 160
Self-citationLanguage identification of encrypted VoIP traffic: Alejandra y Roberto or Alice and Bob?
Wright, C. V., Ballard, L., Monrose, F., & Masson, G. M. (2007) · Cited by 150
"Why 6?" Defining the operational limits of stide, an anomaly-based intrusion detector
Tan, K. M. C., & Maxion, R. A. (2005) · Proceedings - IEEE Symposium on Security and Privacy/Proceedings of the ... IEEE Symposium on Security and Privacy · doi:10.1109/secpri.2002.1004371 · Cited by 143
Challenging the anomaly detection paradigm: a provocative discussion
Gates, C. E., & Taylor, C. (2006) · New Security Paradigms Workshop · doi:10.1145/1278940.1278945 · Cited by 122
Online supervised spam filter evaluation
Cormack, G. V., & Lynam, T. R. (2007) · ACM Transactions on Information Systems · doi:10.1145/1247715.1247717 · Cited by 115
Playing Devil’s Advocate: Inferring Sensitive Information from Anonymized Network Traces
Coull, S. E., Wright, C. V., Monrose, F., Collins, M. P., & Reiter, M. K. (n.d.) · Cited by 110
Results of the DARPA 1998 offline intrusion detection evaluation
Lippmann, R. P., Cunningham, R. K., Fried, D. J., Graf, I., Kendall, K. R., Webster, S. E., & Zissman, M. A. (1999) · Recent Advances in Intrusion Detection · Cited by 94
On the design and performance of prefix-preserving IP traffic trace anonymization
Xu, J. J., Fan, J., Ammar, M., & Moon, S. B. (2001) · ACM SIGCOMM Internet Measurement Workshop (IMW) · doi:10.1145/505202.505234 · Cited by 89
Browser Fingerprinting from Coarse Traffic Summaries: Techniques and Implications
Yen, T.-F., Huang, X., Monrose, F., & Reiter, M. K. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02918-9_10 · Cited by 39
Toward Realistic and Artifact-Free Insider-Threat Data
Killourhy, K. S., & Maxion, R. A. (2007) · Annual Computer Security Applications Conference · doi:10.1109/acsac.2007.31 · Cited by 9
Cited by
Huang, L., Joseph, A. D., Nelson, B., Rubinstein, B. I. P., & Tygar, J. D. (2011) · Proceedings of the 4th ACM workshop on Security and artificial intelligence · doi:10.1145/2046684.2046692 · Cited by 1,194
Boutaba, R., Salahuddin, M. A., Limam, N., Ayoubi, S., Shahriar, N., Estrada-Solano, F., & Caicedo, O. M. (2018) · Journal of Internet Services and Applications · doi:10.1186/s13174-018-0087-2 · Cited by 1,036
Network Intrusion Detection for IoT Security Based on Learning Techniques
Chaabouni, N., Mosbah, M., Zemmari, A., Sauvignac, C., & Faruki, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2019.2896380 · Cited by 940
A survey of intrusion detection techniques for cyber-physical systems
Mitchell, R., & Chen, I.-R. (2014) · ACM Computing Surveys · doi:10.1145/2542049 · Cited by 768
DÏoT: A Federated Self-learning Anomaly Detection System for IoT
Nguyen, T. D., Marchal, S., Miettinen, M., Fereidooni, H., Asokan, N., & Sadeghi, A.-R. (2019) · 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS) · doi:10.1109/icdcs.2019.00080 · Cited by 663
Metadata
- Authors
- Sommer, R., & Paxson, V.
- Venue
- 2010 IEEE Symposium on Security and Privacy
- Publisher
- IEEE
- Published
- 2010
- Pages
- 305-316
- ISSN
- 1081-6011 (ISSN-L)
- OpenAlex
- W1985987493
- Cited by
- 2,085
- References
- 52
- FWCI
- 40.77
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.