CoChat
Sign Up
PreprintCited by 28Adversarial Robustness in Machine LearningInformation and Cyber SecurityNetwork Security and Intrusion Detection

Review of Generative AI Methods in Cybersecurity

Open access
Yigit, Yagmur, Buchanan, William J, Tehrani, Madjid G, Maglaras, Leandros·2024·arXiv
DOI 10.48550/arxiv.2403.08701arXiv 2403.08701
Open this paper in CoChat — free account

Abstract

Over the last decade, Artificial Intelligence (AI) has become increasingly popular, especially with the use of chatbots such as ChatGPT, Gemini, and DALL-E. With this rise, large language models (LLMs) and Generative AI (GenAI) have also become more prevalent in everyday use. These advancements strengthen cybersecurity's defensive posture and open up new attack avenues for adversaries as well. This paper provides a comprehensive overview of the current state-of-the-art deployments of GenAI, covering assaults, jailbreaking, and applications of prompt injection and reverse psychology. This paper also provides the various applications of GenAI in cybercrimes, such as automated hacking, phishing emails, social engineering, reverse cryptography, creating attack payloads, and creating malware. GenAI can significantly improve the automation of defensive cyber security processes through strategies such as dataset construction, safe code development, threat intelligence, defensive measures, reporting, and cyberattack detection. In this study, we suggest that future research should focus on developing robust ethical norms and innovative defense mechanisms to address the current issues that GenAI creates and to also further encourage an impartial approach to its future application in cybersecurity. Moreover, we underscore the importance of interdisciplinary approaches further to bridge the gap between scientific developments and ethical considerations.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2403.08701

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • AI techniques, especially LLMs, have shown great potential in revolutionizing various aspects of cybersecurity.

    “AI techniques, especially LLMs, have shown great potential in revolutionizing various aspects of cybersecurity (Yigit et al. 2024).”

    From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Yigit et al. 2024

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 55

  1. [1][1] Capogrosso, L., Cunico, F., Cheng, D.S., Fummi, F., Cristani, M.: A Machine Learning-Oriented Survey on Tiny Machine Learning. IEEE Access 12 , 2340623426 (2024) https://doi.org/10.1109/ACCESS.2024.3365349 - · DOI
  2. [2][2] Happe, A., Cito, J.: Getting pwn'd by ai: Penetration testing with large language models. arXiv preprint arXiv:2308.00121 (2023) - · arXiv
  3. [3][3] Park, D., An, G.-t., Kamyod, C., Kim, C.G.: A Study on Performance Improvement of Prompt Engineering for Generative AI with a Large Language Model. Journal of Web Engineering 22 (8), 1187-1206 (2023) https://doi.org/10.13052/ jwe1540-9589.2285 -
  4. [4][4] Team, Y.: Yandex Adds Next-generation Neural Network to Alice Virtual Assistant. [Online]. Available: https://yandex.com/company/press center/press releases/2023/17-05-23, Accessed Jan 8, 2024 -
  5. [10][10] Barreto, F., Moharkar, L., Shirodkar, M., Sarode, V., Gonsalves, S., Johns, A.: Generative Artificial Intelligence: Opportunities and Challenges of Large Language Models. In: Balas, V.E., Semwal, V.B., Khandare, A. (eds.) Intelligent Computing and Networking, pp. 545-553. Springer, ??? (2023) -
  6. [12][12] Mohammed, S.P., Hossain, G.: Chatgpt in education, healthcare, and cybersecurity: Opportunities and challenges. In: 2024 IEEE 14th Annual Computing and Communication Workshop and Conference (CCWC), pp. 0316-0321 (2024). IEEE -
  7. [13][13] Alawida, M., Mejri, S., Mehmood, A., Chikhaoui, B., Isaac Abiodun, O.: A comprehensive study of chatgpt: advancements, limitations, and ethical considerations in natural language processing and cybersecurity. Information 14 (8), 462 (2023) -
  8. [17][17] OpenAI: Introducing Gemini: Our Largest and Most Capable AI Model. [Online]. Available: https://cdn.openai.com/papers/gpt-4.pdf, Accessed Dec 12, 2023 (2023) -
  9. [18][18] Frieder, S., Pinchetti, L., Griffiths, R.-R., Salvatori, T., Lukasiewicz, T., Petersen, P., Berner, J.: Mathematical capabilities of chatgpt. Advances in Neural Information Processing Systems 36 (2024) -
  10. [19][19] Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., Amodei, D.: Language models are few-shot learners. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H. (eds.) Advances in Neural Information Processing Systems, vol. 33, pp. 1877-1901. Curran Associates, Inc., ??? (2020). https://proceedings.neurips. - [cc/paper files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf](https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf) -
  11. [20][20] Romera-Paredes, B., Barekatain, M., Novikov, A., Balog, M., Kumar, M.P., Dupont, E., Ruiz, F.J.R., Ellenberg, J.S., Wang, P., Fawzi, O., Kohli, P., Fawzi, A.: Mathematical discoveries from program search with large language models. Nature 625 (7995), 468-475 (2024) https://doi.org/10.1038/s41586-023-06924-6 - · DOI · Paper page
  12. [26][26] Gehman, S., Gururangan, S., Sap, M., Choi, Y., Smith, N.A.: Realtoxicityprompts: Evaluating neural toxic degeneration in language models. In: Findings (2020). https://api.semanticscholar.org/CorpusID:221878771 -
  13. [28][28] Begou, N., Vinoy, J., Duda, A., Korczynski, M.: Exploring the dark side of ai: Advanced phishing attack design and deployment using chatgpt. arXiv preprint arXiv:2309.10463 (2023) - · arXiv
  14. [29][29] Yigit, Y., Bal, B., Karameseoglu, A., Duong, T.Q., Canberk, B.: Digital twinenabled intelligent ddos detection mechanism for autonomous core networks. IEEE Communications Standards Magazine 6 (3), 38-44 (2022) https://doi.org/ 10.1109/MCOMSTD.0001.2100022 - · DOI
  15. [31][31] Yigit, Y., Nguyen, L.D., Ozdem, M., Kinaci, O.K., Hoang, T., Canberk, B., Duong, T.Q.: TwinPort: 5G Drone-assisted Data Collection with Digital Twin for Smart Seaports. Scientific Reports 13 , 12310 (2023) https://doi.org/10.1038/ s41598-023-39366-1 -
  16. [32][32] Gupta, M., Akiri, C., Aryal, K., Parker, E., Praharaj, L.: From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy. IEEE Access (2023) -
  17. [33][33] Li, H., Guo, D., Fan, W., Xu, M., Song, Y.: Multi-step jailbreaking privacy attacks on chatgpt. arXiv preprint arXiv:2304.05197 (2023) - · arXiv
  18. [34][34] Wei, J., Wang, X., Schuurmans, D., Bosma, M., Xia, F., Chi, E., Le, Q.V., Zhou, D., et al. : Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 , 24824-24837 (2022) -
  19. [35][35] Kojima, T., Gu, S.S., Reid, M., Matsuo, Y., Iwasawa, Y.: Large language models are zero-shot reasoners. Advances in neural information processing systems 35 , 22199-22213 (2022) -
  20. [36][36] Xie, Y., Yi, J., Shao, J., Curl, J., Lyu, L., Chen, Q., Xie, X., Wu, F.: Defending chatgpt against jailbreak attack via self-reminder. Nature Machine Intelligence 5 , 1486-1496 (2023) https://doi.org/10.1038/s42256-023-00765-8 - · DOI
  21. [39][39] Falade, P.V.: Decoding the threat landscape: Chatgpt, fraudgpt, and wormgpt in social engineering attacks. arXiv preprint arXiv:2310.05595 (2023) - · arXiv
  22. [40][40] Roy, S.S., Naragam, K.V., Nilizadeh, S.: Generating phishing attacks using chatgpt. arXiv preprint arXiv:2305.05133 (2023) - · arXiv
  23. [46][46] Happe, A., Kaplan, A., Cito, J.: Evaluating llms for privilege-escalation scenarios. arXiv preprint arXiv:2310.11409 (2023) - · arXiv
  24. [47][47] Charan, P., Chunduri, H., Anand, P.M., Shukla, S.K.: From text to mitre techniques: Exploring the malicious use of large language models for generating cyber attack payloads. arXiv preprint arXiv:2305.15336 (2023) - · arXiv
  25. [51][51] Madani, P.: Metamorphic malware evolution: The potential and peril of large language models. In: 2023 5th IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA), pp. 74-81 (2023). IEEE Computer Society -
  26. [53][53] Cintas-Canto, A., Kaur, J., Mozaffari-Kermani, M., Azarderakhsh, R.: Chatgpt vs. lightweight security: First work implementing the nist cryptographic standard ascon. arXiv preprint arXiv:2306.08178 (2023) - · arXiv
  27. [54][54] Iturbe, E., Rios, E., Rego, A., Toledo, N.: Artificial intelligence for next-generation cybersecurity: The ai4cyber framework. In: Proceedings of the 18th International Conference on Availability, Reliability and Security, pp. 1-8 (2023) -
  28. [55][55] Fayyazi, R., Yang, S.J.: On the uses of large language models to interpret ambiguous cyberattack descriptions. arXiv preprint arXiv:2306.14062 (2023) - · arXiv
  29. [56][56] Kereopa-Yorke, B.: Building resilient smes: Harnessing large language models for cyber security in australia. arXiv preprint arXiv:2306.02612 (2023) - · arXiv
  30. [57][57] Perrina, F., Marchiori, F., Conti, M., Verde, N.V.: Agir: Automating cyber threat intelligence reporting with natural language generation. arXiv preprint - arXiv:2310.02655 (2023) - · arXiv
  31. [58][58] Bayer, M., Frey, T., Reuter, C.: Multi-level fine-tuning, data augmentation, and few-shot learning for specialized cyber threat intelligence. Computers & Security 134 , 103430 (2023) https://doi.org/10.1016/j.cose.2023.103430 - · DOI
  32. [61][61] Sharma, T., Kechagia, M., Georgiou, S., Tiwari, R., Vats, I., Moazen, H., Sarro, F.: A survey on machine learning techniques for source code analysis. arXiv preprint arXiv:2110.09610 (2021) - · arXiv
  33. [62][62] OpenAI: GPT-4 Technical Report (2023). https://arxiv.org/abs/2303.08774 Accessed 2023-08-20 - · arXiv
  34. [63][63] Johansen, H.D., Renesse, R.: Firepatch: Secure and time-critical dissemination of software patches. IFIP, 373-384 (2007) https://doi.org/10.1007/ 978-0-387-72367-9 32 . Accessed 2023-08-20 -
  35. [69][69] Sobania, D., Hanna, C., Briesch, M., Petke, J.: An Analysis of the Automatic Bug Fixing Performance of ChatGPT (2023). https://arxiv.org/pdf/2301.08653.pdf - · arXiv
  36. [70][70] Ma, W., Liu, S., Wang, W., Hu, Q., Liu, Y., Zhang, C., Nie, L., Liu, Y.: The Scope of ChatGPT in Software Engineering: A Thorough Investigation (2023). https://arxiv.org/pdf/2305.12138.pdf - · arXiv
  37. [71][71] Li, H., Hao, Y., Zhai, Y., Qian, Z.: The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Models (2023). https://arxiv.org/pdf/2308.00245. pdf Accessed 2023-08-20 - · arXiv
  38. [72][72] Tihanyi, N., Bisztray, T., Jain, R., Ferrag, M., Cordeiro, L., Mavroeidis, V.: THE FORMAI DATASET: GENERATIVE AI IN SOFTWARE SECURITY THROUGH THE LENS OF FORMAL VERIFICATION * (2023). https://arxiv. org/pdf/2307.02192.pdf Accessed 2023-08-20 -
  39. [74][74] Cheshkov, A., Zadorozhny, P., Levichev, R.: Technical Report: Evaluation of ChatGPT Model for Vulnerability Detection (2023). https://arxiv.org/pdf/2304. 07232.pdf -
  40. [75][75] Liu, X., Tan, Y., Xiao, Z., Zhuge, J., Zhou, R.: Not The End of Story: An Evaluation of ChatGPT-Driven Vulnerability Description Mappings (2023). https: //aclanthology.org/2023.findings-acl.229.pdf Accessed 2023-08-22 -
  41. [77][77] Elgedawy, R., Sadik, J., Dutta, S., Gautam, A., Georgiou, K., Gholamrezae, F., Ji, F., Lim, K., Liu, Q., Ruoti, S.: Ocassionally secure: A comparative analysis of code generation assistants. arXiv preprint arXiv:2402.00689 (2024) - · arXiv
  42. [78][78] Kumar, A., Singh, S., Murty, S.V., Ragupathy, S.: The ethics of interaction: Mitigating security threats in llms. arXiv preprint arXiv:2401.12273 (2024) - · arXiv
  43. [79][79] Zhu, H.: Metaaid 2.5: A secure framework for developing metaverse applications via large language models. arXiv preprint arXiv:2312.14480 (2023) - · arXiv
  44. [80][80] O'Brien, J., Ee, S., Williams, Z.: Deployment corrections: An incident response framework for frontier ai models. arXiv preprint arXiv:2310.00328 (2023) - · arXiv
  45. [81][81] Iqbal, U., Kohno, T., Roesner, F.: Llm platform security: Applying a systematic evaluation framework to openai's chatgpt plugins. arXiv preprint arXiv:2309.10254 (2023) - · arXiv
  46. [82][82] Kwon, R., Ashley, T., Castleberry, J., Mckenzie, P., Gourisetti, S.N.G.: Cyber threat dictionary using mitre att&ck matrix and nist cybersecurity framework mapping. In: 2020 Resilience Week (RWS), pp. 106-112 (2020). IEEE -
  47. [83][83] Xiong, W., Legrand, E., ˚ Aberg, O., Lagerstr¨ om, R.: Cyber security threat modeling based on the mitre enterprise att&ck matrix. Software and Systems Modeling 21 (1), 157-177 (2022) -
  48. [84][84] Mavroeidis, V., Bromander, S.: Cyber threat intelligence model: an evaluation of taxonomies, sharing standards, and ontologies within cyber threat intelligence. In: 2017 European Intelligence and Security Informatics Conference (EISIC), pp. 91-98 (2017). IEEE -
  49. [85][85] Garza, E., Hemberg, E., Moskal, S., O'Reilly, U.-M.: Assessing large language model's knowledge of threat behavior in mitre att&ck (2023) -
  50. [86][86] Ferrag, M.A., Ndhlovu, M., Tihanyi, N., Cordeiro, L.C., Debbah, M., Lestable, T.: Revolutionizing cyber threat detection with large language models. arXiv preprint arXiv:2306.14263 (2023) - · arXiv
  51. [87][87] Kholgh, D.K., Kostakos, P.: Pac-gpt: A novel approach to generating synthetic network traffic with gpt-3. IEEE Access (2023) -
  52. [88][88] Simmonds, B.C.: Generating a large web traffic dataset. Master's thesis, ETH Zurich (2023) -
  53. [90][90] Wang, C., Liu, S., Yang, H., Guo, J., Wu, Y., Liu, J.: Ethical considerations of using chatgpt in health care. Journal of Medical Internet Research 25 , 48009 (2023) https://doi.org/10.2196/48009 - · DOI · Paper page
  54. [94][94] Yigit, Y., Chrysoulas, C., Yurdakul, G., Maglaras, L., Canberk, B.: Digital TwinEmpowered Smart Attack Detection System for 6G Edge of Things Networks. In: 2023 IEEE Globecom Workshops (GC Wkshps) (2023) -
  55. [95][95] Yigit, Y., Kinaci, O.K., Duong, T.Q., Canberk, B.: TwinPot: Digital Twinassisted Honeypot for Cyber-Secure Smart Seaports. In: 2023 IEEE International Conference on Communications Workshops (ICC Workshops), pp. 740-745 (2023). https://doi.org/10.1109/ICCWorkshops57953.2023.10283756 · DOI

Cited by

Sorted by citations

Authors
Yigit, Y., Buchanan, W. J., Tehrani, M. G., & Maglaras, L.
Affiliations
  • Edinburgh Napier University (GB)
  • George Washington University (US)
  • De Montfort University (GB)
Corresponding author
Buchanan, William J
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
Volume
5
Pages
241-261
ISSN
2667-3452 (ISSN-L)
DOI
10.48550/arxiv.2403.08701
arXiv
2403.08701
OpenAlex
W4392828284
Cited by
28
References
0
Citations by year
2026: 10 · 2025: 9 · 2024: 9
FWCI
7.69
Type
journal article
Language
en
Open access
Licence
Locations
  • Internet of Things and Cyber-Physical Systems (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Edinburgh Napier Research Repository (Edinburgh Napier University) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
Keywords
generative AI, cybersecurity, large language models, jailbreaking, prompt injection, reverse psychology, cybercrime, phishing, social engineering, malware generation, cyberattack detection, threat intelligence, ethical AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review