PreprintCited by 94Adversarial Robustness in Machine LearningNetwork Security and Intrusion DetectionTopic Modeling

Large Language Models in Cybersecurity: State-of-the-Art

Open access
Motlagh, Farzad Nourmohammadzadeh, Hajizadeh, Mehrdad, Majd, Mehryar, Najafi, Pejman, Cheng, Feng, Meinel, Christoph·2024·arXiv

Abstract

The rise of Large Language Models (LLMs) has revolutionized our comprehension of intelligence bringing us closer to Artificial Intelligence. Since their introduction, researchers have actively explored the applications of LLMs across diverse fields, significantly elevating capabilities. Cybersecurity, traditionally resistant to data-driven solutions and slow to embrace machine learning, stands out as a domain. This study examines the existing literature, providing a thorough characterization of both defensive and adversarial applications of LLMs within the realm of cybersecurity. Our review not only surveys and categorizes the current landscape but also identifies critical research gaps. By evaluating both offensive and defensive applications, we aim to provide a holistic understanding of the potential risks and opportunities associated with LLM-driven cybersecurity.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2402.00891

Cites

90 of 90 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Despite the significant research into LLMs within the field of cybersecurity, the exploration and application of such models remain in their initial stages and have great potential for development.

    “Despite the significant research into LLMs within the field of cybersecurity, the exploration and application of such models remain in their initial stages and have great potential for development(deJesus Coelhoda Silva and Westphall 2024; Motlagh etal. 2024).”

    From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Motlagh et al. 2024

    The Conclusion (p. 8) describes numerous studies of defensive applications and calls for more research on offensive risks. Section 3.4 (p. 5) also identifies underexplored response and recovery applications with potential for further development. These passages support the research and future-potential points, but do not characterize LLM exploration and application across cybersecurity as being in their initial stages. (LLM, conf=0.84)

    Experimental — accuracy not yet measured
  • LLMs provide new opportunities for the cybersecurity community.

    “LLMs provide new opportunities for the cybersecurity community(deJesus Coelho da Silva and Westphall 2024; Motlagh et al. 2024).”

    From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Motlagh et al. 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

12 of the 102 references couldn’t be matched to a known paper.

Research works printed but not linked: 9

  1. [5][5] Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. 2023. Palm 2 technical report. arXiv preprint arXiv:2305.10403 (2023). - · arXiv
  2. [15][15] Critical Infrastructure Cybersecurity. 2014. Framework for improving critical infrastructure cybersecurity. Framework 1, 11 (2014). -
  3. [34][34] Christian Hendriksen. 2023. AI for Supply Chain Management: Disruptive Innovation or Innovative Disruption? Journal of Supply Chain Management (2023). -
  4. [43][43] Ramanpreet Kaur, Dušan Gabrijelčič, and Tomaž Klobučar. 2023. Artificial intelligence for cybersecurity: Literature review and future research directions. Information Fusion (2023), 101804. -
  5. [64][64] Hammond Pearce, Benjamin Tan, Baleegh Ahmad, Ramesh Karri, and Brendan Dolan-Gavitt. 2023. Examining zero-shot vulnerability repair with large language models. In 2023 IEEE Symposium on Security and Privacy (SP) . IEEE, 2339-2356. -
  6. [65][65] Baolin Peng, Chunyuan Li, Pengcheng He, Michel Galley, and Jianfeng Gao. 2023. Instruction tuning with gpt-4. arXiv preprint arXiv:2304.03277 (2023). - · arXiv
  7. [68][68] Javier Rando, Fernando Perez-Cruz, and Briland Hitaj. 2023. PassGPT: Password Modeling and (Guided) Generation with Large Language Models. arXiv preprint arXiv:2306.01545 (2023). - · arXiv
  8. [69][69] Arya Rao, John Kim, Meghana Kamineni, Michael Pang, Winston Lie, and Marc D Succi. 2023. Evaluating ChatGPT as an adjunct for radiologic decisionmaking. medRxiv (2023), 2023-02. -
  9. [72][72] Sayak Saha Roy, Krishna Vamsi Naragam, and Shirin Nilizadeh. 2023. Generating Phishing Attacks using ChatGPT. arXiv e-prints (2023), arXiv-2305. -

Cited by

Sorted by citations

Authors
Motlagh, F. N., Hajizadeh, M., Majd, M., Najafi, P., Cheng, F., & Meinel, C.
Affiliations
  • Hasso Plattner Institute (DE)
  • Chemnitz University of Technology (DE)
Venue
arXiv
Publisher
arXiv
Published
2024
Pages
98-110
OpenAlex
W4407937958
Cited by
92
References
102
Citations by year
2026: 20 · 2025: 55 · 2024: 17
FWCI
71.12
Type
conference paper
Language
en
Open access
Locations
  • International Conference on Information Systems Security and Privacy (ICISSP) (publishedVersion, cc-by-nc-nd)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
Keywords
large language models, cybersecurity, threat detection, security analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review