The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
The base-rate fallacy and the difficulty of intrusion detection
Open accessAbstract
Many different demands can be made of intrusion detection systems. An important requirement is that an intrusion detection system be effective ; that is, it should detect a substantial percentage of intrusions into the supervised system, while still keeping the false alarm rate at an acceptable level. This article demonstrates that, for a reasonable set of assumptions, the false alarm rate is the limiting factor for the performance of an intrusion detection system. This is due to the base-rate fallacy phenomenon, that in order to achieve substantial values of the Bayesian detection rate P(Intrusion***Alarm) , we have to achieve a (perhaps in some cases unattainably) low false alarm rate. A selection of reports of intrusion detection performance are reviewed, and the conclusion is reached that there are indications that at least some types of intrusion detection have far to go before they can attain such low false alarm rates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Engineering Psychology and Human Performance
Wickens, C. D., Hollands, J. G., Banbury, S., & Parasuraman, R. (2015) · Psychology Press eBooks · doi:10.4324/9781315665177 · Cited by 4,982
Denning, D. E. (1987) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1987.232894 · Cited by 3,427
(1986) · North-Holland eBooks · Cited by 1,883
Computer security threat monitoring and surveillance
Anderson, J. (1980) · Medical Entomology and Zoology · Cited by 1,726
Engineering psychology and human performance, 2nd ed.
Wickens, C. D. (1992) · Cited by 1,362
A data mining framework for building intrusion detection models
Lee, W., Stolfo, S. J., & Mok, K. W. (2003) · Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344) · doi:10.1109/secpri.1999.766909 · Cited by 1,148
Detecting intrusions using system calls: alternative data models
Warrender, C., Forrest, S., & Pearlmutter, B. (2003) · Proceedings of the 1999 IEEE Symposium on Security and Privacy (Cat. No.99CB36344) · doi:10.1109/secpri.1999.766910 · Cited by 1,106
Evaluating intrusion detection systems: the 1998 DARPA off-line intrusion detection evaluation
Lippmann, R. P., Fried, D. J., Graf, I., Haines, J. W., Kendall, K. R., McClung, D., Weber, D., Webster, S. E., Wyschogrod, D., Cunningham, R. K., et al. (2002) · Proceedings DARPA Information Survivability Conference and Exposition. DISCEX'00 · doi:10.1109/discex.2000.821506 · Cited by 917
Bace, R., & Mell, P. (2001) · doi:10.6028/nist.sp.800-31 · Cited by 599
Cited by
A detailed analysis of the KDD CUP 99 data set
Tavallaee, M., Bagheri, E., Lu, W., & Ghorbani, A. A. (2009) · 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications · doi:10.1109/cisda.2009.5356528 · Cited by 5,396
Anomaly-based network intrusion detection: Techniques, systems and challenges
García-Teodoro, P., Díaz-Verdejo, J., Maciá-Fernández, G., & Vázquez, E. (2009) · Computers & Security · doi:10.1016/j.cose.2008.08.003 · Cited by 2,085
An overview of anomaly detection techniques: Existing solutions and latest technological trends
Patcha, A., & Park, J.-M. (2007) · Computer Networks · doi:10.1016/j.comnet.2007.02.001 · Cited by 1,561
Network Anomaly Detection: Methods, Systems and Tools
Bhuyan, M. H., Bhattacharyya, D. K., & Kalita, J. K. (2014) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2013.052213.00046 · Cited by 1,348
The economics of information security investment
Gordon, L. A., & Loeb, M. P. (2002) · ACM Transactions on Information and System Security · doi:10.1145/581271.581274 · Cited by 1,335
Boutaba, R., Salahuddin, M. A., Limam, N., Ayoubi, S., Shahriar, N., Estrada-Solano, F., & Caicedo, O. M. (2018) · Journal of Internet Services and Applications · doi:10.1186/s13174-018-0087-2 · Cited by 1,036
Use of K-Nearest Neighbor classifier for intrusion detection
Liao, Y., & Vemuri, V. R. (2002) · Computers & Security · doi:10.1016/s0167-4048(02)00514-x · Cited by 802
Electricity Theft Detection in AMI Using Customers’ Consumption Patterns
Jokar, P., Arianpoo, N., & Leung, V. C. M. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2425222 · Cited by 761
A survey of physics-based attack detection in cyber-physical systems
Giraldo, J., Urbina, D., Cardenas, A., Valente, J., Faisal, M., Ruths, J., Tippenhauer, N. O., Sandberg, H., & Candell, R. (2019) · ACM Computing Surveys · doi:10.1145/3203245 · Cited by 535
“…has a couple of advantages over the false-alarm rate: (1) it addresses the deceptive nature of low false-alarm rates due to the base-rate fallacy [6], and (2) it addresses the problem that some anomaly detection statistics make a decision (“alarm” or “normal behavior”) at non-constant time…”
BackgroundCredit Card Fraud Detection Using Hidden Markov Model
Srivastava, A., Kundu, A., Sural, S., & Majumdar, A. K. (2008) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2007.70228 · Cited by 535
User authentication through keystroke dynamics
Bergadano, F., Gunetti, D., & Picardi, C. (2002) · ACM Transactions on Information and System Security · doi:10.1145/581271.581272 · Cited by 513
A new approach to intrusion detection using Artificial Neural Networks and fuzzy clustering
Wang, G., Hao, J., Ma, J., & Huang, L. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.02.102 · Cited by 505
Deep Learning Based Attack Detection for Cyber-Physical System Cybersecurity: A Survey
Zhang, J., Pan, L., Han, Q.-L., Chen, C., Wen, S., & Xiang, Y. (2022) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2021.1004261 · Cited by 432
Clustering intrusion detection alarms to support root cause analysis
Julisch, K. (2003) · ACM Transactions on Information and System Security · doi:10.1145/950191.950192 · Cited by 419
Credit card fraud detection: A fusion approach using Dempster–Shafer theory and Bayesian learning
Panigrahi, S., Kundu, A., Sural, S., & Majumdar, A. K. (2009) · Information Fusion · doi:10.1016/j.inffus.2008.04.001 · Cited by 347
Limiting the Impact of Stealthy Attacks on Industrial Control Systems
Urbina, D. I., Giraldo, J. A., Cardenas, A. A., Tippenhauer, N. O., Valente, J., Faisal, M., Ruths, J., Candell, R., & Sandberg, H. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978388 · Cited by 343
NoDoze: Combatting Threat Alert Fatigue with Automated Provenance Triage
Hassan, W. U., Guo, S., Li, D., Chen, Z., Jee, K., Li, Z., & Bates, A. (2019) · Proceedings 2019 Network and Distributed System Security Symposium · doi:10.14722/ndss.2019.23349 · Cited by 341
Data preprocessing for anomaly based network intrusion detection: A review
Davis, J. J., & Clark, A. J. (2011) · Computers & Security · doi:10.1016/j.cose.2011.05.008 · Cited by 312
Combating imbalance in network intrusion datasets
Cieslak, D. A., Chawla, N. V., & Striegel, A. (2006) · 2006 IEEE International Conference on Granular Computing · doi:10.1109/grc.2006.1635905 · Cited by 286
A Taxonomy of Network Threats and the Effect of Current Datasets on Intrusion Detection Systems
Hindy, H., Brosset, D., Bayne, E., Seeam, A. K., Tachtatzis, C., Atkinson, R., & Bellekens, X. (2020) · IEEE Access · doi:10.1109/access.2020.3000179 · Cited by 273
Quantified security is a weak hypothesis: a critical survey of results and assumptions
Verendel, V. (2009) · Proceedings of the 2009 workshop on New security paradigms workshop · doi:10.1145/1719030.1719036 · Cited by 180
Wang, K., Zhang, J., Bai, G., Ko, R., & Dong, J. S. (2021) · Proceedings of the Web Conference 2021 · doi:10.1145/3442381.3450008 · Cited by 27
Cybersecurity for Industry 4.0 and Advanced Manufacturing Environments with Ensemble Intelligence
Thames, L., & Schaefer, D. (2017) · Springer Series in Advanced Manufacturing · doi:10.1007/978-3-319-50660-9_10 · Cited by 20
MRCA: metric-level root cause analysis for microservices via multi-modal data
Wang, Y., Zhu, Z., Fu, Q., Ma, Y., & He, P. (2024) · Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/3691620.3695485 · Cited by 18
“However, the anomaly detection modules of current RCA methods commonly use too simple techniques such as N-sigma [3], where the data utilized by RCA are not even normally distributed.”
(2022) · doi:10.1109/msec.2023.3287207 · Cited by 15
Are Machine Learning Models for Malware Detection Ready for Prime Time?
Cavallaro, L., Kinder, J., Pendlebury, F., & Pierazzi, F. (2023) · IEEE Security & Privacy · doi:10.1109/msec.2023.3236543 · Cited by 13
Metadata
- Authors
- Axelsson, S.
- Venue
- ACM Transactions on Information and System Security
- Published
- 2000-08
- Volume
- 3
- Issue
- 3
- Pages
- 186-205
- ISSN
- 1094-9224 (ISSN-L)
- 1557-7406
- OpenAlex
- W2156204309
- Cited by
- 638
- References
- 20
- FWCI
- 14.46
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.