A Big Data Architecture for Large Scale Security Monitoring
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Network traffic is a rich source of information for security monitoring. However the increasing volume of data to treat raises issues, rendering holistic analysis of network traffic difficult. In this paper we propose a solution to cope with the tremendous amount of data to analyse for security monitoring perspectives. We introduce an architecture dedicated to security monitoring of local enterprise networks. The application domain of such a system is mainly network intrusion detection and prevention, but can be used as well for forensic analysis. This architecture integrates two systems, one dedicated to scalable distributed data storage and management and the other dedicated to data exploitation. DNS data, NetFlow records, HTTP traffic and honeypot data are mined and correlated in a distributed system that leverages state of the art big data solution. Data correlation schemes are proposed and their performance are evaluated against several well-known big data framework including Hadoop and Spark.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MapReduce: simplified data processing on large clusters
Dean, J., & Ghemawat, S. (2008) · Communications of the ACM · doi:10.1145/1327452.1327492 · Cited by 18,476
Bro: a system for detecting network intruders in real-time
Paxson, V. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00112-7 · Cited by 2,636 · cited 2×
“The operations of Network Intrusion Detection Systems (NIDS) rely on network traffic analysis, where Snort [3], Bro [4] and Suricata [5] are typical examples.”
BackgroundMethod
Cited by
Big healthcare data: preserving security and privacy
Abouelmehdi, K., Beni-Hessane, A., & Khaloufi, H. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0110-7 · Cited by 738
Moustafa, N., Turnbull, B., & Choo, K.-K. R. (2019) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2871719 · Cited by 582
A novel blockchain-based electronic health record automation system for healthcare
Chelladurai, U., & Pandian, S. (2022) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03163-3 · Cited by 210
Kotenko, I., Saenko, I., Kushnerevich, A., & Branitskiy, A. (2019) · 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP) · doi:10.1109/empdp.2019.8671571 · Cited by 30
Siddique, K., Akhtar, Z., Lee, H.-G., Kim, W., & Kim, Y. (2017) · Symmetry · doi:10.3390/sym9090197 · Cited by 21
Metadata
- Authors
- Marchal, S., Jiang, X., State, R., & Engel, T.
- Venue
- 2014 IEEE International Congress on Big Data
- Publisher
- IEEE
- Published
- 2014-06
- Pages
- 56-63
- OpenAlex
- W1963669090
- Cited by
- 128
- References
- 2
- FWCI
- 10.16
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.