Cited by 176Software System Performance and ReliabilityAnomaly Detection Techniques and ApplicationsNetwork Security and Intrusion Detection

Self-Attentive Classification-Based Anomaly Detection in Unstructured Logs

Open access
Nedelkoski, Sasho, Bogatinovski, Jasmin, Acker, Alexander, Cardoso, Jorge, Kao, Odej·2020·2020 IEEE International Conference on Data Mining (ICDM)

Abstract

The detection of anomalies is an essential data mining task for achieving security and reliability in computer systems. Logs are a common and major data source for anomaly detection methods in almost every computer system. Recent studies have focused predominantly on one-class deep learning methods on manually specified log representations. The main limitation is that these models are not able to learn log representations describing the semantic differences between normal and anomaly logs, leading to a poor generalization on unseen logs. We propose Logsy, a classification-based method to learn log representations that allow to distinguish between normal system log data and anomaly samples from auxiliary log datasets, easily accessible via the internet. The idea behind such an approach to anomaly detection is that the auxiliary dataset is sufficiently informative to enhance the representation of the normal data, yet diverse to regularize against overfitting and improve generalization. We perform several experiments on publicly available datasets to evaluate the performance and properties, where we show improvement of 0.25 in F1 compared to previous methods.

Integrity signals

Registry

Crossref · 10.1109/icdm50108.2020.00148

Cites

26 of 26 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Nedelkoski, S., Bogatinovski, J., Acker, A., Cardoso, J., & Kao, O.
Affiliations
  • Technische Universität Berlin (DE)
  • Huawei German Research Center (DE)
Venue
2020 IEEE International Conference on Data Mining (ICDM)
Publisher
IEEE
Published
2020-11
Pages
1196-1201
ISSN
1550-4786 (ISSN-L)
OpenAlex
W3127712067
Cited by
176
References
26
Citations by year
2026: 22 · 2025: 34 · 2024: 38 · 2023: 47 · 2022: 19 · 2021: 16
FWCI
17.20
Type
conference paper
Language
en
Open access
Locations
  • Proceedings (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
Keywords
anomaly detection, system logs, self-attention, log classification, overfitting regularization, cybersecurity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review