The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
AI^2: Training a Big Data Machine to Defend
Abstract
We present AI2, an analyst-in-the-loop security system where Analyst Intuition (AI) is put together with state-of-the-art machine learning to build a complete end-to-end Artificially Intelligent solution (AI). The system presents four key features: a big data behavioral analytics platform, an outlier detection system, a mechanism to obtain feedback from security analysts, and a supervised learning module. We validate our system with a real-world data set consisting of 3.6 billion log lines and 70.2 million entities. The results show that the system is capable of learning to defend against unseen attacks. With respect to unsupervised outlier analysis, our system improves the detection rate in 2.92× and reduces false positives by more than 5×.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
A Survey of Outlier Detection Methodologies
Hodge, V., & Austin, J. (2004) · Artificial Intelligence Review · doi:10.1007/s10462-004-4304-y · Cited by 3,596
Cited by
N-BaIoT—Network-Based Detection of IoT Botnet Attacks Using Deep Autoencoders
Meidan, Y., Bohadana, M., Mathov, Y., Mirsky, Y., Shabtai, A., Breitenbacher, D., & Elovici, Y. (2018) · IEEE Pervasive Computing · doi:10.1109/mprv.2018.03367731 · Cited by 1,483
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
A survey on addressing high-class imbalance in big data
Leevy, J. L., Khoshgoftaar, T. M., Bauder, R. A., & Seliya, N. (2018) · Journal of Big Data · doi:10.1186/s40537-018-0151-6 · Cited by 759
Combining unsupervised and supervised learning in credit card fraud detection
Carcillo, F., Le Borgne, Y.-A., Caelen, O., Kessaci, Y., Oblé, F., & Bontempi, G. (2021) · Information Sciences · doi:10.1016/j.ins.2019.05.042 · Cited by 478
Thakkar, A., & Lohiya, R. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10037-9 · Cited by 350
Survey of Attack Projection, Prediction, and Forecasting in Cyber Security
Husak, M., Komarkova, J., Bou-Harb, E., & Celeda, P. (2019) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2871866 · Cited by 316
Artificial intelligence in cyber security: research advances, challenges, and opportunities
Zhang, Z., Ning, H., Shi, F., Farha, F., Xu, Y., Xu, J., Zhang, F., & Choo, K.-K. R. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-09976-0 · Cited by 304
SCARFF : A scalable framework for streaming credit card fraud detection with spark
Carcillo, F., Dal Pozzolo, A., Le Borgne, Y.-A., Caelen, O., Mazzer, Y., & Bontempi, G. (2018) · Information Fusion · doi:10.1016/j.inffus.2017.09.005 · Cited by 267
Cyber threat detection based on artificial neural networks using event profiles
Lee, J., Kim, J., Kim, I., & Han, K. (2019) · IEEE Access · doi:10.1109/access.2019.2953095 · Cited by 188
“As mentioned above, there are major limitations such as (1) the comparatively high level of analyst interaction required, (2) lack of labeled data, and (3) constantly evolving attacks [10], [14].”
BackgroundInfluentialInsider Threat Detection with Deep Neural Network
Yuan, F., Cao, Y., Shang, Y., Liu, Y., Tan, J., & Fang, B. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-93698-7_4 · Cited by 168
An Ontology-Based Cybersecurity Framework for the Internet of Things
Mozzaquatro, B. A., Agostinho, C., Goncalves, D., Martins, J., & Jardim-Goncalves, R. (2018) · Sensors · doi:10.3390/s18093053 · Cited by 129
Deep Learning Based Attribute Classification Insider Threat Detection for Data Security
Meng, F., Lou, F., Fu, Y., & Tian, Z. (2018) · 2018 IEEE Third International Conference on Data Science in Cyberspace (DSC) · doi:10.1109/dsc.2018.00092 · Cited by 74
Exploring anomalous behaviour detection and classification for insider threat identification
Le, D. C., & Zincir‐Heywood, N. (2021) · International Journal of Network Management · doi:10.1002/nem.2109 · Cited by 56
Insider Threat Detection using Deep Autoencoder and Variational Autoencoder Neural Networks
Pantelidis, E., Bendiab, G., Shiaeles, S., & Kolokotronis, N. (2021) · 2021 IEEE International Conference on Cyber Security and Resilience (CSR) · doi:10.1109/csr51186.2021.9527925 · Cited by 55
Detecting Malicious Model Updates from Federated Learning on Conditional Variational Autoencoder
Gu, Z., & Yang, Y. (2021) · 2021 IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps49936.2021.00075 · Cited by 47
DANTE: Predicting Insider Threat using LSTM on system logs
Ma, Q., & Rastogi, N. (2020) · 2020 IEEE 19th International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom) · doi:10.1109/trustcom50675.2020.00153 · Cited by 30
Screening Out Social Bots Interference: Are There Any Silver Bullets?
Zago, M., Nespoli, P., Papamartzivanos, D., Perez, M. G., Marmol, F. G., Kambourakis, G., & Perez, G. M. (2019) · IEEE Communications Magazine · doi:10.1109/mcom.2019.1800520 · Cited by 30
Detecting Insider Threat from Behavioral Logs Based on Ensemble and Self-Supervised Learning
Zhang, C., Wang, S., Zhan, D., Yu, T., Wang, T., & Yin, M. (2021) · Security and Communication Networks · doi:10.1155/2021/4148441 · Cited by 30
Insider Threat Detection: Machine Learning Way
Raval, M. S., Gandhi, R., & Chaudhary, S. (2018) · Advances in Information Security · doi:10.1007/978-3-319-97643-3_2 · Cited by 24
Insider Threat Detection Using An Unsupervised Learning Method: COPOD
Sun, X., Wang, Y., & Shi, Z. (2021) · 2021 International Conference on Communications, Information System and Computer Engineering (CISCE) · doi:10.1109/cisce52179.2021.9445898 · Cited by 21
Metadata
- Authors
- Veeramachaneni, K., Arnaldo, I., Korrapati, V., Bassias, C., & Li, K.
- Venue
- 2016 IEEE 2nd International Conference on Big Data Security on Cloud (BigDataSecurity), IEEE International Conference on High Performance and Smart Computing (HPSC), and IEEE International Conference on Intelligent Data and Security (IDS)
- Publisher
- IEEE
- Published
- 2016-04
- Pages
- 49-54
- OpenAlex
- W2466206609
- Cited by
- 245
- References
- 2
- FWCI
- 34.95
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.