CoChat
Sign Up
PreprintCited by 24Topic ModelingAdversarial Robustness in Machine LearningInformation and Cyber Security

The DOI matches its DataCite record.

SECURE: Benchmarking Large Language Models for Cybersecurity

Open access
Bhusal, Dipkamal, Alam, Md Tanvirul, Nguyen, Le, Mahara, Ashim, Lightcap, Zachary, Frazier, Rodney, Fieblinger, Romy, Torales, Grace Long, Blakely, Benjamin A., Rastogi, Nidhi·2024·arXiv
DOI 10.48550/arxiv.2405.20441arXiv 2405.20441
Open this paper in CoChat — free accountOpen PDF

Abstract

Large Language Models (LLMs) have demonstrated potential in cybersecurity applications but have also caused lower confidence due to problems like hallucinations and a lack of truthfulness. Existing benchmarks provide general evaluations but do not sufficiently address the practical and applied aspects of LLM performance in cybersecurity-specific tasks. To address this gap, we introduce the SECURE (Security Extraction, Understanding \& Reasoning Evaluation), a benchmark designed to assess LLMs performance in realistic cybersecurity scenarios. SECURE includes six datasets focussed on the Industrial Control System sector to evaluate knowledge extraction, understanding, and reasoning based on industry-standard sources. Our study evaluates seven state-of-the-art models on these tasks, providing insights into their strengths and weaknesses in cybersecurity contexts, and offer recommendations for improving LLMs reliability as cyber advisory tools.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2405.20441

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 43

  1. A. Zaboli, S. L. Choi, T.-J. Song, and J. Hong, "Chatgpt and other large language models for cybersecurity of smart grid applications," arXiv preprint arXiv:2311.05462, 2023. · arXiv
  2. S. Bubeck, V. Chandrasekaran, R. Eldan, J. Gehrke, E. Horvitz, E. Kamar, P. Lee, Y. T. Lee, Y. Li, S. Lundberg et al., "Sparks of artificial general intelligence: Early experiments with gpt- 4," arXiv preprint arXiv:2303.12712, 2023. · arXiv
  3. L. Weidinger, J. Mellor, M. Rauh, C. Griffin, J. Uesato, P.-S. Huang, M. Cheng, M. Glaese, B. Balle, A. Kasirzadeh et al., "Ethical and social risks of harm from language models," arXiv preprint arXiv:2112.04359, 2021. · arXiv
  4. A. Madaan and A. Yazdanbakhsh, "Text and patterns: For effective chain of thought, it takes two to tango," arXiv preprint arXiv:2209.07686, 2022. · arXiv
  5. A. Wang, A. Singh, J. Michael, F. Hill, O. Levy, and S. R. Bowman, "Glue: A multi-task benchmark and analysis platform for natural language understanding," arXiv preprint arXiv:1804.07461, 2018. · arXiv
  6. D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt, "Measuring massive multitask language understanding," arXiv preprint arXiv:2009.03300, 2020. · arXiv
  7. P. Liang, R. Bommasani, T. Lee, D. Tsipras, D. Soylu, M. Yasunaga, Y. Zhang, D. Narayanan, Y. Wu, A. Kumar et al., "Holistic evaluation of language models," arXiv preprint arXiv:2211.09110, 2022. · arXiv
  8. J. Yu, X. Wang, S. Tu, S. Cao, D. Zhang-Li, X. Lv, H. Peng, Z. Yao, X. Zhang, H. Li et al., "Kola: Carefully benchmarking world knowledge of large language models," in The Twelfth International Conference on Learning Representations, 2023.
  9. X. Qi, Y. Zeng, T. Xie, P.-Y. Chen, R. Jia, P. Mittal, and P. Henderson, "Fine-tuning aligned language models compro- mises safety, even when users do not intend to!" arXiv preprint arXiv:2310.03693, 2023. · arXiv
  10. Z. Gekhman, G. Yona, R. Aharoni, M. Eyal, A. Feder, R. Re- ichart, and J. Herzig, "Does fine-tuning llms on new knowledge encourage hallucinations?" arXiv preprint arXiv:2405.05904, 2024. · arXiv
  11. A. Q. Jiang, A. Sablayrolles, A. Mensch, C. Bamford, D. S. Chaplot, D. d. l. Casas, F. Bressand, G. Lengyel, G. Lample, L. Saulnier et al., "Mistral 7b," arXiv preprint arXiv:2310.06825, 2023. · arXiv
  12. E. Aghaei, X. Niu, W. Shadid, and E. Al-Shaer, "Securebert: A domain-specific language model for cybersecurity," in Interna- tional Conference on Security and Privacy in Communication Systems. Springer, 2022, pp. 39-56.
  13. M. Bayer, P. Kuehn, R. Shanehsaz, and C. Reuter, "Cysecbert: A domain-adapted language model for the cybersecurity do- main," ACM Transactions on Privacy and Security, vol. 27, no. 2, pp. 1-20, 2024.
  14. G. Team, T. Mesnard, C. Hardin, R. Dadashi, S. Bhupatiraju, S. Pathak, L. Sifre, M. Rivière, M. S. Kale, J. Love et al., "Gemma: Open models based on gemini research and tech- nology," arXiv preprint arXiv:2403.08295, 2024. · arXiv
  15. B. Roziere, J. Gehring, F. Gloeckle, S. Sootla, I. Gat, X. E. Tan, Y. Adi, J. Liu, T. Remez, J. Rapin et al., "Code llama: Open foundation models for code," arXiv preprint arXiv:2308.12950, 2023. · arXiv
  16. A. Shestov, A. Cheshkov, R. Levichev, R. Mussabayev, P. Zadorozhny, E. Maslov, C. Vadim, and E. Bulychev, "Fine- tuning large language models for vulnerability detection," arXiv preprint arXiv:2401.17010, 2024. · arXiv
  17. M. A. Ferrag, A. Battah, N. Tihanyi, M. Debbah, T. Lestable, and L. C. Cordeiro, "Securefalcon: The next cyber reasoning system for cyber security," arXiv preprint arXiv:2307.06616, 2023. · arXiv
  18. R. Fang, R. Bindu, A. Gupta, and D. Kang, "Llm agents can autonomously exploit one-day vulnerabilities," arXiv preprint arXiv:2404.08144, 2024. · arXiv
  19. Z. Li, S. Dutta, and M. Naik, "Llm-assisted static anal- ysis for detecting security vulnerabilities," arXiv preprint arXiv:2405.17238, 2024. · arXiv
  20. A. Silva, S. Fang, and M. Monperrus, "Repairllama: Efficient representations and fine-tuned adapters for program repair," arXiv preprint arXiv:2312.15698, 2023. · arXiv
  21. H. Guo, J. Yang, J. Liu, L. Yang, L. Chai, J. Bai, J. Peng, X. Hu, C. Chen, D. Zhang et al., "Owl: A large language model for it operations," arXiv preprint arXiv:2309.09298, 2023. · arXiv
  22. M. Sultana, A. Taylor, L. Li, and S. Majumdar, "Towards evaluation and understanding of large language models for cyber operation automation," in 2023 IEEE Conference on Communications and Network Security (CNS). IEEE, 2023, pp. 1-6.
  23. N. Tihanyi, M. A. Ferrag, R. Jain, and M. Debbah, "Cybermet- ric: A benchmark dataset for evaluating large language models knowledge in cybersecurity," arXiv preprint arXiv:2402.07688, 2024. · arXiv
  24. Z. Liu, "Secqa: A concise question-answering dataset for evaluating large language models in computer security," arXiv preprint arXiv:2312.15838, 2023. · arXiv
  25. Y. Miao, Y. Bai, L. Chen, D. Li, H. Sun, X. Wang, Z. Luo, D. Sun, and X. Xu, "An empirical study of netops capa- bility of pre-trained large language models," arXiv preprint arXiv:2309.05557, 2023. · arXiv
  26. Y. Liu, C. Pei, L. Xu, B. Chen, M. Sun, Z. Zhang, Y. Sun, S. Zhang, K. Wang, H. Zhang et al., "Opseval: A comprehen- sive task-oriented aiops benchmark for large language models," arXiv preprint arXiv:2310.07637, 2023. · arXiv
  27. S. Ullah, M. Han, S. Pujar, H. Pearce, A. Coskun, and G. Stringhini, "Llms cannot reliably identify and reason about security vulnerabilities (yet?): A comprehensive evaluation, framework, and benchmarks," in IEEE Symposium on Security and Privacy, 2024.
  28. M. T. Alam, D. Bhushl, L. Nguyen, and N. Rastogi, "Ctibench: A benchmark for evaluating llms in cyber threat intelligence," arXiv preprint arXiv:2406.07599, 2024. · arXiv
  29. F. Petroni, T. Rocktäschel, P. Lewis, A. Bakhtin, Y. Wu, A. H. Miller, and S. Riedel, "Language models as knowledge bases?" arXiv preprint arXiv:1909.01066, 2019. · arXiv
  30. J. A. Collins and I. R. Olson, "Knowledge is power: How con- ceptual knowledge transforms visual cognition," Psychonomic bulletin & review, vol. 21, pp. 843-860, 2014.
  31. S. Cao, J. Shi, L. Pan, L. Nie, Y. Xiang, L. Hou, J. Li, B. He, and H. Zhang, "Kqa pro: A dataset with explicit compositional programs for complex question answering over knowledge base," in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022, pp. 6101-6119.
  32. S. Kim, J. Shin, Y. Cho, J. Jang, S. Longpre, H. Lee, S. Yun, S. Shin, S. Kim, J. Thorne et al., "Prometheus: Inducing evaluation capability in language models," in NeurIPS 2023 Workshop on Instruction Tuning and Instruction Following, 2023.
  33. L. Zheng, W.-L. Chiang, Y. Sheng, S. Zhuang, Z. Wu, Y. Zhuang, Z. Lin, Z. Li, D. Li, E. Xing et al., "Judging llm-as-a-judge with mt-bench and chatbot arena," Advances in Neural Information Processing Systems, vol. 36, 2024.
  34. T. B. Brown, "Language models are few-shot learners," arXiv preprint arXiv:2005.14165, 2020. · arXiv
  35. T. Kojima, S. S. Gu, M. Reid, Y. Matsuo, and Y. Iwasawa, "Large language models are zero-shot reasoners," Advances in neural information processing systems, vol. 35, pp. 22 199- 22 213, 2022.
  36. C.-Y. Lin, "ROUGE: A package for automatic evaluation of summaries," in Text Summarization Branches Out. Barcelona, Spain: Association for Computational Linguistics, Jul. 2004, pp. 74-81. [Online]. Available: https://aclanthology. org/W04-1013
  37. V. Adlakha, P. BehnamGhader, X. H. Lu, N. Meade, and S. Reddy, "Evaluating correctness and faithfulness of instruction-following models for question answering," Trans- actions of the Association for Computational Linguistics, vol. 12, pp. 775-793, 2024.
  38. P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-t. Yih, T. Rocktäschel et al., "Retrieval-augmented generation for knowledge- intensive nlp tasks," Advances in Neural Information Process- ing Systems, vol. 33, pp. 9459-9474, 2020.
  39. B. Zhang, Z. Liu, C. Cherry, and O. Firat, "When scaling meets llm finetuning: The effect of data, model and finetuning method," arXiv preprint arXiv:2402.17193, 2024. · arXiv
  40. A. Barbaresi, "Trafilatura: A Web Scraping Library and Command-Line Tool for Text Discovery and Extraction," in Proceedings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: System Demonstrations. Association for Computational Linguistics, 2021, pp. 122-131. [Online]. Available: https://aclanthology.org/2021.acl-demo.15
  41. Y. Wang, Y. Kordi, S. Mishra, A. Liu, N. A. Smith, D. Khashabi, and H. Hajishirzi, "Self-instruct: Aligning lan- guage models with self-generated instructions," arXiv preprint arXiv:2212.10560, 2022. · arXiv
  42. Y. Gao, Y. Xiong, X. Gao, K. Jia, J. Pan, Y. Bi, Y. Dai, J. Sun, and H. Wang, "Retrieval-augmented generation for large lan- guage models: A survey," arXiv preprint arXiv:2312.10997, 2023. · arXiv
  43. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, "Attention is all you need," Advances in neural information processing systems, vol. 30, 2017.

Cited by

See all 24

Metadata

Authors
Bhusal, D., Alam, M. T., Nguyen, L., Mahara, A., Lightcap, Z., Frazier, R., Fieblinger, R., Torales, G. L., Blakely, B. A., & Rastogi, N.
Affiliations
  • Rochester Institute of Technology (US)
  • Argonne National Laboratory (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Pages
15-30
ISSN
1063-9527 (ISSN-L)
DOI
10.48550/arxiv.2405.20441
arXiv
2405.20441
OpenAlex
W4408565663
Cited by
24
References
0
Citations by year
2026: 14 · 2025: 10
FWCI
7.03
Type
conference paper
Language
en
Open access
Licence
Locations
  • Annual Computer Security Applications Conference (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
  • U.S. Department of Energy
  • Office of Science
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
Keywords
large language models, industrial control systems, knowledge extraction, knowledge understanding, reasoning, hallucinations, LLM reliability, benchmark dataset

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: SECURE: Benchmarking Large Language Models for Cybersecurity. https://app.cochat.ai/papers/10.48550/arxiv.2405.20441
The paper
Bhusal, D., Alam, M. T., Nguyen, L., Mahara, A., Lightcap, Z., Frazier, R., Fieblinger, R., Torales, G. L., Blakely, B. A., & Rastogi, N. (2024). SECURE: Benchmarking Large Language Models for Cybersecurity. arXiv. https://doi.org/10.48550/arxiv.2405.20441