CoChat
Sign Up
PreprintCited by 5Speech and dialogue systemsInformation and Cyber SecurityNetwork Security and Intrusion Detection

Cyber Sentinel: Exploring Conversational Agents in Streamlining Security Tasks with GPT-4

Open access
Kaheh, Mehrdad, Kholgh, Danial Khosh, Kostakos, Panos·2023·arXiv
DOI 10.48550/arxiv.2309.16422arXiv 2309.16422
Open this paper in CoChat — free accountOpen PDF

Abstract

In an era where cyberspace is both a battleground and a backbone of modern society, the urgency of safeguarding digital assets against ever-evolving threats is paramount. This paper introduces Cyber Sentinel, an innovative task-oriented cybersecurity dialogue system that is effectively capable of managing two core functions: explaining potential cyber threats within an organization to the user, and taking proactive/reactive security actions when instructed by the user. Cyber Sentinel embodies the fusion of artificial intelligence, cybersecurity domain expertise, and real-time data analysis to combat the multifaceted challenges posed by cyber adversaries. This article delves into the process of creating such a system and how it can interact with other components typically found in cybersecurity organizations. Our work is a novel approach to task-oriented dialogue systems, leveraging the power of chaining GPT-4 models combined with prompt engineering across all sub-tasks. We also highlight its pivotal role in enhancing cybersecurity communication and interaction, concluding that not only does this framework enhance the system's transparency (Explainable AI) but also streamlines the decision-making process and responding to threats (Actionable AI), therefore marking a significant advancement in the realm of cybersecurity communication.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2309.16422

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • By simulating complex network behaviors and attack patterns, and integrating advanced natural language processing capabilities, LLM agents introduce new perspectives and solutions to the field of cybersecurity.

    “By simulating complex network behaviors and attack patterns, and integrating advanced natural language processing capabilities, LLM agents introduce new perspectives and solutions to the field of cybersecurity(Kaheh etal. 2023; Moskal etal. 2023; Cui etal. 2024; Rigaki etal. 2024; Fang etal. 2024c; An etal. 2024).”

    From When LLMs meet cybersecurity: a systematic literature review (2025) · cites this paper as Kaheh et al. 2023

    The Introduction and Conclusions describe a GPT-4 conversational agent that helps analysts interpret threat intelligence and perform security tasks, supporting the claim that LLM agents offer cybersecurity solutions. The paper does not describe its agent simulating complex network behaviors or attack patterns; searches for those concepts found no supporting passage. (LLM, conf=0.88)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 60

  1. A. J. Varela-Vaca, R. M. Gasca, J. A. Carmona-Fombella, and M. T. Gómez-López, "Amadeus: Towards the automated security testing," in Proceedings of the 24th ACM Conference on Systems and Software Product Line: Volume A -Volume A, SPLC '20, (New York, NY, USA), Association for Computing Machinery, 2020.
  2. S. Liu, Z. Hou, Y. Guo, and L. Guo, "A novel modified robust model- free adaptive control method for a class of nonlinear systems with time delay," in 2019 IEEE 8th Data Driven Control and Learning Systems Conference (DDCLS), pp. 1329-1334, 2019.
  3. P. Gao, F. Shao, X. Liu, X. Xiao, Z. Qin, F. Xu, P. Mittal, S. R. Kulkarni, and D. Song, "Enabling efficient cyber threat hunting with cyber threat intelligence," in 2021 IEEE 37th International Conference on Data Engineering (ICDE), pp. 193-204, 2021.
  4. S. Sheikhi and P. Kostakos, "Cyber threat hunting using unsupervised federated learning and adversary emulation," in 2023 IEEE International Conference on Cyber Security and Resilience (CSR), pp. 315-320, 2023.
  5. M. A. Ali Ansari, M. Shahid, A. J. Khan, M. S. e. Ali, and K. A. Mehmood, "The effects of project assessment, safety management train- ing, and risk assessment on migrant labor," Journal of Social Sciences Review, vol. 2, p. 35-44, Dec. 2022.
  6. L. Wang and R. Jones, "Big data analytics in cybersecurity: Network data and intrusion prediction," in 2019 IEEE 10th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEM- CON), pp. 0105-0111, 2019.
  7. S. Sheikhi and P. Kostakos, "A novel anomaly-based intrusion detection model using psogwo-optimized bp neural network and ga-based feature selection," Sensors, vol. 22, no. 23, p. 9318, 2022.
  8. O. Ajayi and A. Gangopadhyay, "Dahid: Domain adaptive host-based intrusion detection," in 2021 IEEE International Conference on Cyber Security and Resilience (CSR), pp. 467-472, 2021.
  9. M. Choraś and M. Pawlicki, "Intrusion detection approach based on optimised artificial neural network," Neurocomputing, vol. 452, pp. 705- 715, 2021.
  10. L. Fernández Maimó, A. Huertas Celdrán, A. L. Perales Gómez, F. J. García Clemente, J. Weimer, and I. Lee, "Intelligent and dynamic ransomware spread detection and mitigation in integrated clinical en- vironments," Sensors, vol. 19, no. 5, 2019.
  11. P. Nespoli, F. G. Mármol, and J. M. Vidal, "A bio-inspired reaction against cyberattacks: Ais-powered optimal countermeasures selection," IEEE Access, vol. 9, pp. 60971-60996, 2021.
  12. Y. Cao, S. Li, Y. Liu, Z. Yan, Y. Dai, P. S. Yu, and L. Sun, "A comprehensive survey of ai-generated content (aigc): A history of generative ai from gan to chatgpt," arXiv preprint arXiv:2303.04226, 2023. · arXiv
  13. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, "Bert: Pre-training of deep bidirectional transformers for language understanding," arXiv preprint arXiv:1810.04805, 2018. · arXiv
  14. F. Setianto, E. Tsani, F. Sadiq, G. Domalis, D. Tsakalidis, and P. Kostakos, "Gpt-2c: A parser for honeypot logs using large pre-trained language models," in Proceedings of the 2021 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, pp. 649-653, 2021.
  15. F. Xu, H. Uszkoreit, Y. Du, W. Fan, D. Zhao, and J. Zhu, "Explainable ai: A brief survey on history, research areas, approaches and challenges," in Natural Language Processing and Chinese Computing (J. Tang, M.-Y. Kan, D. Zhao, S. Li, and H. Zan, eds.), (Cham), pp. 563-574, Springer International Publishing, 2019.
  16. D. Wilkins, S. Lindley, M. Meijer, R. Banks, and B. Burlin, "Designing ai systems that make organizational knowledge actionable," Interactions, vol. 27, p. 72-75, nov 2020.
  17. I. Linkov, S. Galaitsi, B. D. Trump, J. M. Keisler, and A. Kott, "Cybertrust: From explainable to actionable and interpretable artificial intelligence," Computer, vol. 53, no. 9, pp. 91-96, 2020.
  18. A. Lamb, "A brief introduction to generative models," arXiv preprint arXiv:2103.00265, 2021. · arXiv
  19. I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, and Y. Bengio, "Generative adversarial nets," Advances in neural information processing systems, vol. 27, 2014.
  20. D. P. Kingma and M. Welling, "Auto-encoding variational bayes," arXiv preprint arXiv:1312.6114, 2013. · arXiv
  21. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, "Attention is all you need," Advances in neural information processing systems, vol. 30, 2017.
  22. OpenAI, "Gpt-4 technical report," ArXiv, vol. abs/2303.08774, 2023. · arXiv
  23. C. Zhang, C. Zhang, S. Zheng, Y. Qiao, C. Li, M. Zhang, S. K. Dam, C. M. Thwal, Y. L. Tun, L. L. Huy, et al., "A complete survey on generative ai (aigc): Is chatgpt from gpt-4 to gpt-5 all you need?," arXiv preprint arXiv:2303.11717, 2023. · arXiv
  24. H. Dai, Z. Liu, W. Liao, X. Huang, Z. Wu, L. Zhao, W. Liu, N. Liu, S. Li, D. Zhu, et al., "Chataug: Leveraging chatgpt for text data augmentation," arXiv preprint arXiv:2302.13007, 2023. · arXiv
  25. P. Lee, S. Bubeck, and J. Petro, "Benefits, limits, and risks of gpt-4 as an ai chatbot for medicine," New England Journal of Medicine, vol. 388, no. 13, pp. 1233-1239, 2023. PMID: 36988602.
  26. S. Wang, Z. Zhao, X. Ouyang, Q. Wang, and D. Shen, "Chatcad: Interactive computer-aided diagnosis on medical image using large language models," arXiv preprint arXiv:2302.07257, 2023. · arXiv
  27. D. M. Katz, M. J. Bommarito, S. Gao, and P. Arredondo, "Gpt-4 passes the bar exam," Available at SSRN 4389233, 2023.
  28. Y. Liu, T. Han, S. Ma, J. Zhang, Y. Yang, J. Tian, H. He, A. Li, M. He, Z. Liu, et al., "Summary of chatgpt/gpt-4 research and per- spective towards the future of large language models," arXiv preprint arXiv:2304.01852, 2023. · arXiv
  29. J. White, Q. Fu, S. Hays, M. Sandborn, C. Olea, H. Gilbert, A. El- nashar, J. Spencer-Smith, and D. C. Schmidt, "A prompt pattern catalog to enhance prompt engineering with chatgpt," arXiv preprint arXiv:2302.11382, 2023. · arXiv
  30. J. Wei, X. Wang, D. Schuurmans, M. Bosma, F. Xia, E. Chi, Q. V. Le, D. Zhou, et al., "Chain-of-thought prompting elicits reasoning in large language models," Advances in Neural Information Processing Systems, vol. 35, pp. 24824-24837, 2022.
  31. S. Yao, D. Yu, J. Zhao, I. Shafran, T. L. Griffiths, Y. Cao, and K. Narasimhan, "Tree of thoughts: Deliberate problem solving with large language models," arXiv preprint arXiv:2305.10601, 2023. · arXiv
  32. X. Wang, J. Wei, D. Schuurmans, Q. Le, E. Chi, S. Narang, A. Chowdh- ery, and D. Zhou, "Self-consistency improves chain of thought reasoning in language models," arXiv preprint arXiv:2203.11171, 2022. · arXiv
  33. J. D. Williams, A. Raux, and M. Henderson, "The dialog state tracking challenge series: A review," Dialogue & Discourse, vol. 7, no. 3, pp. 4- 33, 2016.
  34. F. Ye, J. Manotumruksa, Q. Zhang, S. Li, and E. Yilmaz, "Slot self- attentive dialogue state tracking," in Proceedings of the Web Conference 2021, pp. 1598-1608, 2021.
  35. X. Li, Q. Li, W. Wu, and Q. Yin, "Generation and extraction com- bined dialogue state tracking with hierarchical ontology integration," in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, (Online and Punta Cana, Dominican Republic), pp. 2241-2249, Association for Computational Linguistics, Nov. 2021.
  36. A. Khraisat, I. Gondal, P. Vamplew, and J. Kamruzzaman, "Survey of intrusion detection systems: techniques, datasets and challenges," Cybersecurity, vol. 2, no. 1, pp. 1-22, 2019.
  37. N. A. Azeez, T. M. Bada, S. Misra, A. Adewumi, C. Van der Vyver, and R. Ahuja, "Intrusion detection and prevention systems: an updated review," Data Management, Analytics and Innovation: Proceedings of ICDMAI 2019, Volume 1, pp. 685-696, 2020.
  38. M. Amrollahi, S. Hadayeghparast, H. Karimipour, F. Derakhshan, and G. Srivastava, "Enhancing network security via machine learning: op- portunities and challenges," Handbook of big data privacy, pp. 165-189, 2020.
  39. J. Arevalo Herrera and J. E. Camargo, "A survey on machine learn- ing applications for software defined network security," in Applied Cryptography and Network Security Workshops: ACNS 2019 Satellite Workshops, SiMLA, Cloud S&P, AIBlock, and AIoTS, Bogota, Colombia, June 5-7, 2019, Proceedings 17, pp. 70-93, Springer, 2019.
  40. S. Hou and X. Huang, "Use of machine learning in detecting network security of edge computing system," in 2019 IEEE 4th International Conference on Big Data Analytics (ICBDA), pp. 252-256, IEEE, 2019.
  41. G. González-Granadillo, S. González-Zarzosa, and R. Diaz, "Security information and event management (siem): Analysis, trends, and usage in critical infrastructures," Sensors, vol. 21, no. 14, 2021.
  42. S. M. M. Hossain, R. Couturier, J. Rusk, and K. B. Kent, "Automatic event categorizer for siem," in Proceedings of the 31st Annual Inter- national Conference on Computer Science and Software Engineering, CASCON '21, (USA), p. 104-112, IBM Corp., 2021.
  43. A. DORIA, Identification of cyber attacks using Next Generation pro- tection tools: NGFW, NG-SIEM, AI and Machine Learning. PhD thesis, University of Padova, 2022.
  44. A. R. Muhammad, P. Sukarno, and A. A. Wardana, "Integrated security information and event management (siem) with intrusion detection system (ids) for live analysis based on machine learning," Procedia Computer Science, vol. 217, pp. 1406-1415, 2023.
  45. T. D. Wagner, K. Mahbub, E. Palomar, and A. E. Abdallah, "Cyber threat intelligence sharing: Survey and research directions," Computers & Security, vol. 87, p. 101589, 2019.
  46. S. Mittal, A. Joshi, and T. Finin, "Cyber-all-intel: An ai for security related threat intelligence," arXiv preprint arXiv:1905.02895, 2019. · arXiv
  47. H. Suryotrisongko, Y. Musashi, A. Tsuneda, and K. Sugitani, "Robust botnet dga detection: Blending xai and osint for cyber threat intelligence sharing," IEEE Access, vol. 10, pp. 34613-34624, 2022.
  48. K. Renaud, M. Warkentin, and G. Westerman, From ChatGPT to Hack- GPT: Meeting the Cybersecurity Threat of Generative AI. California: O'Reilly, 2023.
  49. K. Aryal, M. Gupta, and M. Abdelsalam, "A survey on adversarial attacks for malware analysis," arXiv preprint arXiv:2111.08223, 2021. · arXiv
  50. M. Gupta, C. Akiri, K. Aryal, E. Parker, and L. Praharaj, "From chatgpt to threatgpt: Impact of generative ai in cybersecurity and privacy," IEEE Access, 2023.
  51. F. McKee and D. Noever, "Chatbots in a botnet world," arXiv preprint arXiv:2212.11126, 2022. · arXiv
  52. R. Karanjai, "Targeted phishing campaigns using large scale language models," arXiv preprint arXiv:2301.00665, 2022. · arXiv
  53. D. K. Kholgh, Synthetic network traffic generation using generative modeling. Msc thesis, University of Oulu, Oulu, Finland, 2023.
  54. T. McIntosh, T. Liu, T. Susnjak, H. Alavizadeh, A. Ng, R. Nowrozy, and P. Watters, "Harnessing gpt-4 for generation of cybersecurity grc policies: A focus on ransomware attack mitigation," Computers & Security, vol. 134, p. 103424, 2023.
  55. P. Ranade, A. Piplai, S. Mittal, A. Joshi, and T. Finin, "Generating fake cyber threat intelligence using transformer-based models," in 2021 International Joint Conference on Neural Networks (IJCNN), pp. 1-9, 2021.
  56. M. Markevych and M. Dawson, "A review of enhancing intrusion detection systems for cybersecurity using artificial intelligence (ai)," in International conference KNOWLEDGE-BASED ORGANIZATION, vol. 29,3, pp. 30-37, 2023.
  57. Y.-C. Fung and L.-K. Lee, "A chatbot for promoting cybersecurity awareness," in Cyber Security, Privacy and Networking: Proceedings of ICSPN 2021, pp. 379-387, Springer, 2022.
  58. V. Jüttner, M. Grimmer, and E. Buchmann, "Chatids: Explainable cybersecurity using generative ai," arXiv preprint arXiv:2306.14504, 2023. · arXiv
  59. A. Happe and J. Cito, "Getting pwn'd by ai: Penetration testing with large language models," arXiv preprint arXiv:2308.00121, 2023. · arXiv
  60. G. Deng, Y. Liu, V. Mayoral-Vilches, P. Liu, Y. Li, Y. Xu, T. Zhang, Y. Liu, M. Pinzger, and S. Rass, "Pentestgpt: An llm-empowered automatic penetration testing tool," arXiv preprint arXiv:2308.06782, 2023. · arXiv

Cited by

Sorted by citations

Authors
Kaheh, M., Kholgh, D. K., & Kostakos, P.
Affiliations
University of Oulu (FI)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2309.16422
arXiv
2309.16422
OpenAlex
W4387224542
Cited by
5
References
0
Citations by year
2025: 2 · 2024: 3
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
Keywords
chatbots, task-oriented dialogue systems, GPT-4, cybersecurity, prompt engineering, explainable AI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review