A Systematic Review on Machine Learning Insider Threat Detection Models, Datasets and Evaluation Metrics
Open accessAbstract
Computers are crucial instruments providing a competitive edge to organizations that have adopted them. Their pervasive presence has presented a novel challenge to information security, specifically threats emanating from privileged employees. Various solutions have been tried to address the vice, but no exhaustive solution has been found. Due to their elusive nature, proactive strategies have been proposed of which detection using Machine Learning models has been favoured. The choice of algorithm, datasets and metrics are cornerstones of model performance and hence, need to be addressed. Although multiple studies on ML for insider threat detection have been done, none has provided a comprehensive analysis of algorithms, datasets and metrics for development of Insider Threat Detection models. This study conducts a comprehensive systematic literature review using reputable databases to answer the research questions posed. Search strings, inclusion and exclusion criteria were set for eligibility of articles published in the last decade.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
False Positives (FP) and False Negatives (FN) metrics are vital for understanding the errors made by insider threat detection models.
“False Positives (FP) and False Negatives (FN) metrics are vital for understanding the errors made by insider threat detection models [90].”
From A Review of Recent Advances, Challenges, and Opportunities in Malicious Insider Threat Detection Using Machine Learning Methods (2024) · cites this paper as [90]
Cites
Evaluating Machine Learning Models and Their Diagnostic Value
Varoquaux, G., & Colliot, O. (2023) · Neuromethods · doi:10.1007/978-1-0716-3195-9_20 · Cited by 242 · see citing works
Impact and Key Challenges of Insider Threats on Organizations and Critical Businesses
Saxena, N., Hayes, E., Bertino, E., Ojo, P., Choo, K.-K. R., & Burnap, P. (2020) · Electronics · doi:10.3390/electronics9091460 · Cited by 136 · see citing works
Insider Threat Detection Based on User Behavior Modeling and Anomaly Detection Algorithms
Kim, J., Park, M., Kim, H., Cho, S., & Kang, P. (2019) · Applied Sciences · doi:10.3390/app9194018 · Cited by 134 · see citing works
User Behavior Analytics for Anomaly Detection Using LSTM Autoencoder - Insider Threat Detection
Sharma, B., Pokharel, P., & Joshi, B. (2020) · Proceedings of the 11th International Conference on Advances in Information Technology · doi:10.1145/3406601.3406610 · Cited by 130 · see citing works
Scenario-Based Insider Threat Detection From Cyber Activities
Chattopadhyay, P., Wang, L., & Tan, Y.-P. (2018) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2018.2857473 · Cited by 115 · see citing works
Handling Insider Threat Through Supervised Machine Learning Techniques
Janjua, F., Masood, A., Abbas, H., & Rashid, I. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.10.012 · Cited by 48 · see citing works
Applying One-Class Algorithms for Data Stream-Based Insider Threat Detection
Peccatiello, R. B., Gondim, J. J. C., & Garcia, L. P. F. (2023) · IEEE Access · doi:10.1109/access.2023.3293825 · Cited by 25 · see citing works
Padmavathi, G., Shanmugapriya, D., & Asha, S. (2022) · 2022 9th International Conference on Computing for Sustainable Global Development (INDIACom) · doi:10.23919/indiacom54597.2022.9763205 · Cited by 15 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Alzaabi, F. R., & Mehmood, A. (2024) · IEEE Access · doi:10.1109/access.2024.3369906 · Cited by 204 · see citing works
“False Positives (FP) and False Negatives (FN) metrics are vital for understanding the errors made by insider threat detection models [90].”
Background
- Authors
- Wanyonyi, E. N., Abeka, S., & Masinde, N.
- Affiliations
- Murang'a University of Technology (KE)
- Jaramogi Oginga Odinga University of Science and Technology (KE)
- Venue
- International Journal of Network Security & Its Applications
- Published
- 2023-11-29
- Volume
- 15
- Issue
- 6
- Pages
- 37-56
- ISSN
- 0974-9330 (ISSN-L)
- 0975-2307
- OpenAlex
- W4389506125
- Cited by
- 2
- References
- 8
- Citations by year
- 2025: 1 · 2024: 1
- FWCI
- 0.08
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- International Journal of Network Security & Its Applications (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Keywords
- insider threat detection, information security, machine learning models, benchmark dataset, evaluation metrics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review