LLMs Killed the Script Kiddie: How Agents Supported by Large Language Models Change the Landscape of Network Threat Testing
Open accessAbstract
In this paper, we explore the potential of Large Language Models (LLMs) to reason about threats, generate information about tools, and automate cyber campaigns. We begin with a manual exploration of LLMs in supporting specific threat-related actions and decisions. We proceed by automating the decision process in a cyber campaign. We present prompt engineering approaches for a plan-act-report loop for one action of a threat campaign and and a prompt chaining design that directs the sequential decision process of a multi-action campaign. We assess the extent of LLM's cyber-specific knowledge w.r.t the short campaign we demonstrate and provide insights into prompt design for eliciting actionable responses. We discuss the potential impact of LLMs on the threat landscape and the ethical considerations of using LLMs for accelerating threat actor capabilities. We report a promising, yet concerning, application of generative AI to cyber threats. However, the LLM's capabilities to deal with more complex networks, sophisticated vulnerabilities, and the sensitivity of prompts are open questions. This research should spur deliberations over the inevitable advancements in LLM-supported cyber adversarial landscape.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
By simulating complex network behaviors and attack patterns, and integrating advanced natural language processing capabilities, LLM agents introduce new perspectives and solutions to the field of cybersecurity.
“By simulating complex network behaviors and attack patterns, and integrating advanced natural language processing capabilities, LLM agents introduce new perspectives and solutions to the field of cybersecurity(Kaheh etal. 2023; Moskal etal. 2023; Cui etal. 2024; Rigaki etal. 2024; Fang etal. 2024c; An etal. 2024).”
From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Moskal et al. 2023
The Introduction and Conclusion describe using natural-language prompts and an LLM-supported agent to plan and execute a cyber campaign. But Section 4.1 says the demonstration used one intentionally vulnerable target, and Section 6.2 says the proof of concept does not address complex multi-hop networks. The claim overstates the network complexity demonstrated by this source. (LLM, conf=0.89)
Experimental — accuracy not yet measuredMoskal et al. (2023) conclude that while preliminary, their work demonstrates that LLMs show strong potential for cyber threats.
“They conclude that while this work is preliminary, it demonstrates that LLMs shows strong potential for cyber threats.”
From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Moskal et al. (2023)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 19
- CHADHA, R., BOWEN, T., CHIANG, C.-Y. J., GOTTLIEB, Y. M., POYLISHER, A., SAPELLO, A., SERBAN, C., SUGRIM, S., WALTHER, G., MARVEL, L. M., ET AL. Cybervan: A cyber security virtual as- sured network testbed. In MILCOM 2016-2016 IEEE Military Commu- nications Conference (2016), IEEE, pp. 1125-1130.
- CHOWDHERY, A., NARANG, S., DEVLIN, J., BOSMA, M., MISHRA, G., ROBERTS, A., BARHAM, P., CHUNG, H. W., SUTTON, C., GEHRMANN, S., ET AL. Palm: Scaling language modeling with path- ways. arXiv preprint arXiv:2204.02311 (2022). · arXiv
- DASGUPTA, I., KAESER-CHEN, C., MARINO, K., AHUJA, A., BABAYAN, S., HILL, F., AND FERGUS, R. Collaborating with language models for embodied reasoning. arXiv preprint arXiv:2302.00763 (2023). · arXiv
- HEMBERG, E., KELLY, J., SHLAPENTOKH-ROTHMAN, M., REIN- STADLER, B., XU, K., RUTAR, N., AND O'REILLY, U.-M. Bron- linking attack tactics, techniques, and patterns with defensive weak- nesses, vulnerabilities and affected platform configurations. arXiv preprint arXiv:2010.00533 (2020). · arXiv
- HEMBERG, E., AND O'REILLY, U.-M. Using a collated cyberse- curity dataset for machine learning and artificial intelligence. ArXiv abs/2108.02618 (2021). · arXiv
- HUANG, W., ABBEEL, P., PATHAK, D., AND MORDATCH, I. Lan- guage models as zero-shot planners: Extracting actionable knowledge for embodied agents. In International Conference on Machine Learning (2022), PMLR, pp. 9118-9147.
- HUANG, W., XIA, F., XIAO, T., CHAN, H., LIANG, J., FLORENCE, P., ZENG, A., TOMPSON, J., MORDATCH, I., CHEBOTAR, Y., SER- MANET, P., BROWN, N., JACKSON, T., LUU, L., LEVINE, S., HAUS- MAN, K., AND ICHTER, B. Inner monologue: Embodied reason- ing through planning with language models. In arXiv preprint arXiv:2207.05608 (2022). · arXiv
- IZACARD, G., LEWIS, P., LOMELI, M., HOSSEINI, L., PETRONI, F., SCHICK, T., DWIVEDI-YU, J., JOULIN, A., RIEDEL, S., AND GRAVE, E. Few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299 (2022). · arXiv
- MOSKAL, S., HEMBERG, E., AND O'REILLY, U.-M. Cyberevo: evo- lutionary search of knowledge-based behaviors in a cyber attack cam- paign. In Proceedings of the Genetic and Evolutionary Computation Conference Companion (2022), pp. 2168-2176.
- MOSKAL, S., YANG, S. J., AND KUHL, M. E. Cyber threat assess- ment via attack scenario simulation using an integrated adversary and network modeling approach. The Journal of Defense Modeling and Simulation 15, 1 (2018), 13-29.
- O'REILLY, U.-M., TOUTOUH, J., PERTIERRA, M., SANCHEZ, D. P., GARCIA, D., LUOGO, A. E., KELLY, J., AND HEMBERG, E. Ad- versarial genetic programming for cyber security: A rising application domain where gp matters. Genetic Programming and Evolvable Ma- chines 21 (2020), 219-250.
- RADFORD, A., WU, J., CHILD, R., LUAN, D., AMODEI, D., SUTSKEVER, I., ET AL. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- RAE, J. W., BORGEAUD, S., CAI, T., MILLICAN, K., HOFFMANN, J., SONG, F., ASLANIDES, J., HENDERSON, S., RING, R., YOUNG, S., ET AL. Scaling language models: Methods, analysis & insights from training gopher. arXiv preprint arXiv:2112.11446 (2021). · arXiv
- SCAO, T. L., FAN, A., AKIKI, C., PAVLICK, E., ILI Ć, S., HESSLOW, D., CASTAGNÉ, R., LUCCIONI, A. S., YVON, F., GALLÉ, M., ET AL. Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint arXiv:2211.05100 (2022). · arXiv
- SHAO, Z., GONG, Y., SHEN, Y., HUANG, M., DUAN, N., AND CHEN, W. Synthetic prompting: Generating chain-of-thought demonstrations for large language models. arXiv preprint arXiv:2302.00618 (2023). · arXiv
- TOUVRON, H., LAVRIL, T., IZACARD, G., MARTINET, X., LACHAUX, M.-A., LACROIX, T., ROZIÈRE, B., GOYAL, N., HAMBRO, E., AZHAR, F., ET AL. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023). · arXiv
- WANG, X., WEI, J., SCHUURMANS, D., LE, Q., CHI, E., NARANG, S., CHOWDHERY, A., AND ZHOU, D. Self-consistency improves chain of thought reasoning in language models, 2023.
- WEI, J., WANG, X., SCHUURMANS, D., BOSMA, M., CHI, E., LE, Q., AND ZHOU, D. Chain of thought prompting elicits reasoning in large language models. arXiv preprint arXiv:2201.11903 (2022). · arXiv
- YAMIN, M. M., KATT, B., AND GKIOULOS, V. Cyber ranges and se- curity testbeds: Scenarios, functions, tools and architecture. Computers & Security 88 (2020), 101636.
Cited by
Sorted by citations
When LLMs meet cybersecurity: a systematic literature review
Zhang, J., Bu, H., Wen, H., Liu, Y., Fei, H., Xi, R., Li, L., Yang, Y., Zhu, H., & Meng, D. (2025) · Cybersecurity · doi:10.1186/s42400-025-00361-w · Cited by 220 · see citing works
Jaffal, N. O., Alkhanafseh, M., & Mohaisen, D. (2025) · AI · doi:10.3390/ai6090216 · Cited by 69 · see citing works
- Authors
- Moskal, S., Laney, S., Hemberg, E., & O'Reilly, U.-M.
- Affiliations
- Massachusetts Institute of Technology (US)
- Draper Laboratory (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2310.06936
- OpenAlex
- W4387595846
- Cited by
- 11
- References
- 0
- Citations by year
- 2025: 2 · 2024: 9
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- arXiv (Cornell University) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Keywords
- large language models, prompt engineering, prompt chaining, cyber threat landscape
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
