The DOI matches its Crossref record; 50 of the 52 references it cites were found in a registry or an index, and 2 are not checked yet.
Digital deception: generative artificial intelligence in social engineering and phishing
Open accessAbstract
The advancement of Artificial Intelligence (AI) and Machine Learning (ML) has profound implications for both the utility and security of our digital interactions. This paper investigates the transformative role of Generative AI in Social Engineering (SE) attacks. We conduct a systematic review of social engineering and AI capabilities and use a theory of social engineering to identify three pillars where Generative AI amplifies the impact of SE attacks: Realistic Content Creation, Advanced Targeting and Personalization, and Automated Attack Infrastructure. We integrate these elements into a conceptual model designed to investigate the complex nature of AI-driven SE attacks—the Generative AI Social Engineering Framework. We further explore human implications and potential countermeasures to mitigate these risks. Our study aims to foster a deeper understanding of the risks, human implications, and countermeasures associated with this emerging paradigm, thereby contributing to a more secure and trustworthy human-computer interaction.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Coordinated fleets of specialized agents can launch thousands of subtle, context-aware interactions that, taken together, are far more likely to sway or manipulate individuals than a single adversary could (Schmitt & Flechais, 2024;Falade, 2023).”
From Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents (2025) · cites this paper as Schmitt & Flechais, 2024
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacy
Gupta, M., Akiri, C., Aryal, K., Parker, E., & Praharaj, L. (2023) · IEEE Access · doi:10.1109/access.2023.3300381 · Cited by 992
Deep learning models for digital image processing: a review
Archana, R., & Jeevaraj, P. S. E. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-023-10631-z · Cited by 735
Greshake, K., Abdelnabi, S., Mishra, S., Endres, C., Holz, T., & Fritz, M. (2023) · Proceedings of the 16th ACM Workshop on Artificial Intelligence and Security · doi:10.1145/3605764.3623985 · Cited by 667 · cited 1×
“The expectation that individuals can scrutinize every email they receive is impractical and counterproductive, especially in today’s fast-paced digital environment, that comes with heavy cognitive workload (Kosch et al. 2023 ).”
Artificial intelligence for cybersecurity: Literature review and future research directions
Kaur, R., Gabrijelčič, D., & Klobučar, T. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.101804 · Cited by 615
Tikkinen-Piri, C., Rohunen, A., & Markkula, J. (2018) · Computer Law & Security Review · doi:10.1016/j.clsr.2017.05.015 · Cited by 460
A comprehensive survey of AI-enabled phishing attacks detection techniques
Basit, A., Zafar, M., Liu, X., Javed, A. R., Jalil, Z., & Kifayat, K. (2020) · Telecommunication Systems · doi:10.1007/s11235-020-00733-2 · Cited by 436
Flexible brain–computer interfaces
Tang, X., Shen, H., Zhao, S., Li, N., & Jia Liu, B. (2023) · Nature Electronics · doi:10.1038/s41928-022-00913-9 · Cited by 405
Emergent analogical reasoning in large language models
Webb, T., Holyoak, K. J., & Lu, H. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01659-w · Cited by 404
Research works printed but not linked: 1
- Daniel K (2013) Thinking, fast and slow. Farrar, Straus and Giroux
Cited by
Sorted by citations
Artificial intelligence and consumer behavior: From predictive to generative AI
Hermann, E., & Puntoni, S. (2024) · Journal of Business Research · doi:10.1016/j.jbusres.2024.114720 · Cited by 316
Mapping the ethics of generative AI: a comprehensive scoping review
Hagendorff, T. (2024) · Minds and Machines · doi:10.1007/s11023-024-09694-w · Cited by 141
Application of Large Language Models in Cybersecurity: A Systematic Literature Review
Hasanov, I. J., Virtanen, S., Hakkala, A., & Isoaho, J. (2024) · IEEE Access · doi:10.1109/access.2024.3505983 · Cited by 128
From Vulnerability to Defense: The Role of Large Language Models in Enhancing Cybersecurity
Kasri, W., Himeur, Y., Alkhazaleh, H. A., Tarapiah, S., Atalla, S., Mansoor, W., & Al-Ahmad, H. (2025) · Computation · doi:10.3390/computation13020030 · Cited by 87
Industry 4.0 data security: A cybersecurity frameworks review
Toussaint, M., Krima, S., & Panetto, H. (2024) · Journal of Industrial Information Integration · doi:10.1016/j.jii.2024.100604 · Cited by 69
Metadata
- Authors
- Schmitt, M., & Flechais, I.
- Affiliations
- University of Oxford (GB)
- Corresponding author
- Schmitt, Marc
- ORCID
- Schmitt, Marc
- Venue
- Artificial Intelligence Review
- Published
- 2024-10-12
- Volume
- 57
- Issue
- 12
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W4403360640
- Cited by
- 198
- References
- 50
- Citations by year
- 2026: 100 · 2025: 79 · 2024: 18
- FWCI
- 74.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Artificial Intelligence Review (publishedVersion, cc-by)
- SSRN Electronic Journal (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
- Keywords
- generative AI, social engineering, phishing, AI-driven attacks, countermeasures, human-computer interaction security, deception
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review