Cited by 6Software System Performance and ReliabilityNetwork Security and Intrusion DetectionAdversarial Robustness in Machine Learning

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

CLogLLM: A Large Language Model Enabled Approach to Cybersecurity Log Anomaly Analysis

Ren, Hengyi, Lan, Kun, Sun, Zhi, Liao, Shan·2024·2024 4th International Conference on Electronic Information Engineering and Computer Communication (EIECC)

Abstract

Log data is commonly used to record the status of the system and the events that occur, which are often used to assist security staff to determine whether the system is abnormal, diagnose problems, troubleshooting. However, with the increasing complexity of the system, the log data becomes more and more numerous and complex, Therefore the analysis of the log becomes extremely difficult. Not coincidentally, with the emergence of various system software updates, traditional deep learning-based anomaly detection methods, which rely on pre-existing data for training, often struggle to maintain their effectiveness. At the same time, simply detecting anomalies in significant number of complex log data is no longer meet operational needs. Therefore, LLM which is capable of realizing zero-shot learning and text generation has attracted attention. This paper proposed method which is based on the implementation of LLMs for security log detection and analysis. The approach involves fine-tuning the LLMs to improve their adaptability to complex and diverse log data. Moreover, It incorporates two advanced prompt engineering techniques, ToT and Self-Refine, while also exploring the combination of existing techniques such as CoT and In-Context prompting. These three different prompt engineering methods significantly enhance the LLMs' the accuracy in log anomaly detection and the quality in generation of log anomaly analysis.

Overview

Integrity signals

Registry

Crossref · 10.1109/eiecc64539.2024.10929078

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLMs are capable of zero-shot reasoning over heterogeneous textual artifacts without bespoke feature engineering.

    “The first is the emergence of large language models (LLMs) capable of zero-shot reasoning over heterogeneous textual artifacts-packet captures rendered as text, system logs, threat-intelligence reports, MITRE ATT&CK technique descriptions, CVE narratives-without bespoke feature engineering”

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. Hu, 2021, Lora: Low-rank adaptation of large language models[J], arxiv preprint
  2. Liu, 2021, P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks[J], arxiv preprint
  3. Madaan, 2024, Self-Refine: Iterative refinement with self-feedback[J], Advances in Neural Information Processing Systems, 36
  4. Cui, 2024, LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis[J], arxiv preprint

Cited by

Sorted by citations

Metadata

Authors
Ren, H., Lan, K., Sun, Z., & Liao, S.
Affiliations
Technology Group Corporation,The 30th Research Institute of China Electronics,Chengdu,China,610041
Venue
2024 4th International Conference on Electronic Information Engineering and Computer Communication (EIECC)
Publisher
IEEE
Published
2024-12-27
Pages
963-970
OpenAlex
W4408857514
Cited by
5
References
16
Citations by year
2026: 4 · 2025: 1
FWCI
2.18
Type
conference paper
Language
en
Open access
closed
Locations
International Conference on Electronic Information Engineering and Computer Communication (EIECC) (publishedVersion)
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
Keywords
log anomaly detection, large language models, prompt engineering, zero-shot learning, in-context learning, chain-of-thought prompting, self-refinement, LLM fine-tuning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review