CoChat

Transformer-based LLMs in Cybersecurity: An in-depth Study on Log Anomaly Detection and Conversational Defense Mechanisms

Balasubramanian, Prasasthy, Seby, Justin, Kostakos, Panos · 2023 · 2023 IEEE International Conference on Big Data (BigData)

The DOI matches its Crossref record; 16 of the 17 references it cites were found in a registry or an index.

Abstract

With the advancement of conversational AI and Large Language Models (LLMs), interactive chatbots are emerging as pivotal assets for connecting with users across various sectors, enabling various capabilities and functions. However, their potential in the cybersecurity domain remains largely untapped. This article introduces a novel method to enhance chatbot performance by incorporating anomaly detection features. Our chatbot uses advanced GPT-3 models and rule-based logic to identify and extract unusual patterns and deviations within logs, making it more proficient in detecting anomalies. We present the architecture and methodology behind our anomaly detection system, showcasing its effectiveness in real-world scenarios. Combining machine learning and domain expertise, our chatbot sets a new standard in interactive, anomaly-aware conversational agents. Our anomaly detection classifier was able to achieve more than 99% of accuracy by illustrating its robust performance in accurately identifying and flagging outliers or unusual patterns in log file data. We also compared the performance of GPT-3 models with other LLMs: BERT, DistilBERT, and ALBERT. Our findings concluded that GPT-3 models consistently outperform all the other LLM models and exhibit significantly higher performance.

Overview

Integrity signals

Registry

Crossref · 10.1109/bigdata59044.2023.10386976

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 16 references

Research works printed but not linked: 3

  1. He, 2020, Loghub: A large collection of system log datasets towards automated log analytics, arXiv preprint arXiv:2008.06448 · arXiv
  2. Saxena, 2021, IoT Dynamic Log File Analysis: Security Approach for Anomaly Detection In Multi Sensor Environment, International research journal of modernization in engineering technology & Science, 3, 2582
  3. 10.7717/peerj.12726/table-1 · doi:10.7717/peerj.12726/table-1

Cited by

See all 23

Metadata

Authors
Balasubramanian, P., Seby, J., & Kostakos, P.
Affiliations
University of Oulu (FI)
Venue
2023 IEEE International Conference on Big Data (BigData)
Publisher
IEEE
Published
2023-12-15
Pages
3590-3599
OpenAlex
W4391094158
Cited by
22
References
17
Citations by year
2026: 4 · 2025: 12 · 2024: 6
FWCI
6.65
Type
conference paper
Language
en
Open access
closed
Locations
IEEE International Conference on Big Data (BigData) (publishedVersion)
Funders
  • European Commission
  • Academy of Finland
Topics
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
Keywords
log anomaly detection, chatbots, large language models, GPT-3, cybersecurity, transformer models, BERT, DistilBERT, ALBERT, model comparison

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Transformer-based LLMs in Cybersecurity: An in-depth Study on Log Anomaly Detection and Conversational Defense Mechanisms. https://app.cochat.ai/papers/10.1109/bigdata59044.2023.10386976
The paper
Balasubramanian, P., Seby, J., & Kostakos, P. (2023). Transformer-based LLMs in Cybersecurity: An in-depth Study on Log Anomaly Detection and Conversational Defense Mechanisms. 2023 IEEE International Conference on Big Data (BigData). https://doi.org/10.1109/bigdata59044.2023.10386976

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.