Empirical Detection Techniques of Insider Threat Incidents
Open accessThe DOI matches its Crossref record; 73 of the 76 references it cites were found in a registry or an index.
Abstract
Vital organizations have faced increasing challenges of how to defend against insider threats that may cause a severe damage to their assets. The nature of insider threats is more challenging than external threats, as insiders have a privileged access to sensitive assets of an organization. In fact, there are several studies that reviewed the insider threat detection approaches from taxonomical and theoretical perspectives. However, the protection against insider threat incidents requires empirical defense solutions. Hence, our study uniquely focuses on empirical detection approaches that are validated with empirical results. We propose a 10-question model that highlights different prospective of empirical detection approaches. Significant factors are also proposed to reveal the extent to which the detection approaches are effective against insider threat incidents (e.g., feature domains, protection coverage, classification techniques, simulated scenarios, performance and accuracy metrics, etc.). The objective of this paper is to enhance researchers' efforts in the domain of insider attack by systemizing the detection techniques in comparable manner. It also highlights the challenges and gaps for further research to institute more effective solutions that can predict, detect, and prevent emerging attack incidents. Some recommendations for future research directions are also presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The authors of [62], [63] show that the effectiveness of these methods hinges on the quality of the baseline behavior models.”
From A Review of Recent Advances, Challenges, and Opportunities in Malicious Insider Threat Detection Using Machine Learning Methods (2024) · cites this paper as [63]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Recurrent Neural Networks (RNNs) and Long Short-Term Memory (LSTM) networks, designed to handle sequential data, excel in capturing temporal dependencies in user behavior, making them well-suited for insider threat detection [63], [77].”
From A Review of Recent Advances, Challenges, and Opportunities in Malicious Insider Threat Detection Using Machine Learning Methods (2024) · cites this paper as [63]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
An empirical comparison of supervised learning algorithms
Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143865 · Cited by 2,780
Bro: a system for detecting network intruders in real-time
Paxson, V. (1999) · Computer Networks · doi:10.1016/s1389-1286(99)00112-7 · Cited by 2,636
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585 · cited 1×
“[76] assured that research implementation approaches cannot be tested or reused without full and precise description of experiments’ components.”
BackgroundUsing grounded theory as a method for rigorously reviewing literature
Wolfswinkel, J. F., Furtmueller, E., & Wilderom, C. P. M. (2013) · European Journal of Information Systems · doi:10.1057/ejis.2011.51 · Cited by 1,154
Lim, T.-S., Loh, W.-Y., & Shih, Y.-S. (2000) · Machine Learning · doi:10.1023/a:1007608224229 · Cited by 1,133
Detecting and Preventing Cyber Insider Threats: A Survey
Liu, L., De Vel, O., Han, Q.-L., Zhang, J., & Xiang, Y. (2018) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2018.2800740 · Cited by 385
A framework for understanding and predicting insider attacks
Schultz, E. E. (2002) · Computers & Security · doi:10.1016/s0167-4048(02)01009-x · Cited by 324
StatLog: Comparison of classification algorithms on large real-world problems
KING, R. D., FENG, C., & SUTHERLAND, A. (1995) · Applied Artificial Intelligence · doi:10.1080/08839519508945477 · Cited by 320
A Survey of Insider Attack Detection Research
Salem, M. B., Hershkop, S., & Stolfo, S. J. (2008) · Advances in Information Security · doi:10.1007/978-0-387-77322-3_5 · Cited by 280
The insider threat to information systems and the effectiveness of ISO17799
Theoharidou, M., Kokolakis, S., Karyda, M., & Kiountouzis, E. (2005) · Computers & Security · doi:10.1016/j.cose.2005.05.002 · Cited by 244
Scenarios as a scholarly methodology to produce “interesting research”
Ramirez, R., Mukherjee, M., Vezzoli, S., & Kramer, A. M. (2015) · Futures · doi:10.1016/j.futures.2015.06.006 · Cited by 212
Understanding Insider Threat: A Framework for Characterising Attacks
Nurse, J. R. C., Buckley, O., Legg, P. A., Goldsmith, M., Creese, S., Wright, G. R. T., & Whitty, M. (2014) · 2014 IEEE Security and Privacy Workshops · doi:10.1109/spw.2014.38 · Cited by 212
A survey on data leakage prevention systems
Alneyadi, S., Sithirasenan, E., & Muthukkumarasamy, V. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.01.008 · Cited by 208
Cappelli, D. M., Moore, A. P., & Trzeciak, R. F. (2012) · International Linear Collider · Cited by 192
Insiders and Insider Threats:An Overview of Definitions and Mitigation Techniques
Hunker, J., & Probst, C. W. (2011) · Cited by 185
A Data-Centric Approach to Insider Attack Detection in Database Systems
Mathew, S., Petropoulos, M., Ngo, H. Q., & Upadhyaya, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15512-3_20 · Cited by 163
Sarkar, K. R. (2010) · Information Security Technical Report · doi:10.1016/j.istr.2010.11.002 · Cited by 162
Gheyas, I. A., & Abdallah, A. E. (2016) · Big Data Analytics · doi:10.1186/s41044-016-0006-0 · Cited by 150
Automated Insider Threat Detection System Using User and Role-Based Profile Assessment
Legg, P. A., Buckley, O., Goldsmith, M., & Creese, S. (2017) · IEEE Systems Journal · doi:10.1109/jsyst.2015.2438442 · Cited by 145
One-Class Training for Masquerade Detection
Wang, K., & Stolfo, S. J. (2003) · doi:10.7916/d89c7455 · Cited by 141
Greitzer, F. L., & Frincke, D. A. (2010) · Advances in information security · doi:10.1007/978-1-4419-7133-3_5 · Cited by 133
Behavioral Analysis of Insider Threat: A Survey and Bootstrapped Prediction in Imbalanced Data
Azaria, A., Richardson, A., Kraus, S., & Subrahmanian, V. S. (2014) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2014.2377811 · Cited by 133
Detecting insider threats in a real corporate database of computer usage activity
Senator, T. E., Goldberg, H. G., Memory, A., Young, W. T., Rees, B., Pierce, R., Huang, D., Reardon, M., Bader, D. A., Chow, E., et al. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2488213 · Cited by 130
Modeling User Search Behavior for Masquerade Detection
Salem, M. B., & Stolfo, S. J. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-23644-0_10 · Cited by 129 · cited 3×
“Two detection approaches in [42] and [32] employed this dataset to test the their performance.”
MethodDetecting insider threats by monitoring system call activity
Nguyen, N., Reiher, P., & Kuenning, G. H. (2004) · IEEE Systems, Man and Cybernetics SocietyInformation Assurance Workshop, 2003. · doi:10.1109/smcsia.2003.1232400 · Cited by 124
Modeling Human Behavior to Anticipate Insider Attacks
Greitzer, F. L., & Hohimer, R. E. (2011) · Journal of Strategic Security · doi:10.5038/1944-0472.4.2.2 · Cited by 121
Insider Threat Detection Using a Graph-Based Approach
Eberle, W., Graves, J., & Holder, L. (2010) · Journal of Applied Security Research · doi:10.1080/19361610.2011.529413 · Cited by 118
Proactive Insider Threat Detection through Graph Learning and Psychological Context
Brdiczka, O., Liu, J., Price, B., Shen, J., Patil, A., Chow, R., Bart, E., & Ducheneaut, N. (2012) · 2012 IEEE Symposium on Security and Privacy Workshops · doi:10.1109/spw.2012.29 · Cited by 115
elicit: A System for Detecting Insiders Who Violate Need-to-Know
Maloof, M. A., & Stephens, G. D. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74320-0_8 · Cited by 101
Multi-Domain Information Fusion for Insider Threat Detection
Eldardiry, H., Bart, E., Liu, J., Hanley, J., Price, B., & Brdiczka, O. (2013) · 2013 IEEE Security and Privacy Workshops · doi:10.1109/spw.2013.14 · Cited by 100
We have met the enemy and he is us
Bishop, M., Engle, S., Peisert, S., Whalen, S., & Gates, C. (2008) · Proceedings of the 2008 New Security Paradigms Workshop · doi:10.1145/1595676.1595678 · Cited by 93
Insiders Behaving Badly: Addressing Bad Actors and Their Actions
Pfleeger, S. L., Predd, J. B., Hunker, J., & Bulford, C. (2010) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2009.2039591 · Cited by 91
Detecting Anomalous Insiders in Collaborative Information Systems
Chen, Y., Nyemba, S., & Malin, B. (2012) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2012.11 · Cited by 89
A Bayesian Network Model for Predicting Insider Threats
Axelrad, E. T., Sticha, P. J., Brdiczka, O., & Shen, J. (2013) · 2013 IEEE Security and Privacy Workshops · doi:10.1109/spw.2013.35 · Cited by 76
A comparison of system call feature representations for insider threat detection
Liu, A., Martin, C., Hetherington, T., & Matzner, S. (2005) · Proceedings from the Sixth Annual IEEE Systems, Man and Cybernetics (SMC) Information Assurance Workshop, 2005. · doi:10.1109/iaw.2005.1495972 · Cited by 74
Common Sense Guide to Mitigating Insider Threats 4th Edition
Silowash, G., Cappelli, D., Moore, A., Trzeciak, R., Shimeall, T. J., & Flynn, L. (2012) · doi:10.21236/ada585500 · Cited by 74
Classification of Insider Threat Detection Techniques
Sanzgiri, A., & Dasgupta, D. (2016) · Proceedings of the 11th Annual Cyber and Information Security Research Conference · doi:10.1145/2897795.2897799 · Cited by 68 · cited 1×
“in [17] and [16] that there is a little work in the literature that prevent insider attacks.”
BackgroundCommon Sense Guide to Mitigating Insider Threats, 4th Edition
Silowash, G. J., Cappelli, D. M., Moore, A. P., Trzeciak, R. F., Shimeall, T. J., & Flynn, L. (2018) · KiltHub Repository · doi:10.1184/r1/6572639.v1 · Cited by 64
Detecting insider threats through language change.
Taylor, P. J., Dando, C. J., Ormerod, T. C., Ball, L. J., Jenkins, M. C., Sandham, A., & Menacere, T. (2013) · Law and Human Behavior · doi:10.1037/lhb0000032 · Cited by 59 · cited 3×
“In [60], the authors conducted a simulation to detect insider threats using language changes.”
BackgroundMethodGraph Based Framework for Malicious Insider Threat Detection
Gamachchi, A., Sun, L., & Boztas, S. (2017) · Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.24251/hicss.2017.319 · Cited by 59
Shavlik, J., & Shavlik, M. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014084 · Cited by 50
System Level User Behavior Biometrics using Fisher Features and Gaussian Mixture Models
Song, Y., Ben Salem, M., Hershkop, S., & Stolfo, S. J. (2013) · 2013 IEEE Security and Privacy Workshops · doi:10.1109/spw.2013.33 · Cited by 49
Supervised Learning for Insider Threat Detection Using Stream Mining
Parveen, P., Weger, Z. R., Thuraisingham, B., Hamlen, K., & Khan, L. (2011) · 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence · doi:10.1109/ictai.2011.176 · Cited by 45
Requirements Engineering Visualization: A Systematic Literature Review
Abad, Z. S. H., Noaeen, M., & Ruhe, G. (2016) · 2016 IEEE 24th International Requirements Engineering Conference (RE) · doi:10.1109/re.2016.61 · Cited by 45
Detecting Insider Threats: Solutions and Trends
Zeadally, S., Yu, B., Jeong, D. H., & Liang, L. (2012) · Information Security Journal: A Global Perspective · doi:10.1080/19393555.2011.654318 · Cited by 37
Position: "insider" is relative
Bishop, M. (2005) · Proceedings of the 2005 workshop on New security paradigms - NSPW '05 · doi:10.1145/1146269.1146288 · Cited by 37
Role-Based Profile Analysis for Scalable and Accurate Insider-Anomaly Detection
Park, J. S., & Giordano, J. (2006) · 2006 IEEE International Performance Computing and Communications Conference · doi:10.1109/.2006.1629440 · Cited by 37
Insider threat detection and its future directions
Ko, L. L., Divakaran, D. M., Liau, Y. S., & Thing, V. L. L. (2017) · International Journal of Security and Networks · doi:10.1504/ijsn.2017.10005217 · Cited by 34
Camiña, J. B., Hernández, C., Monroy, R., & Trejo, L. A. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.022 · Cited by 33
Two-stage database intrusion detection by combining multiple evidence and belief update
Panigrahi, S., Sural, S., & Majumdar, A. K. (2010) · Information Systems Frontiers · doi:10.1007/s10796-010-9252-2 · Cited by 30
Improving Operating System Fingerprinting using Machine Learning Techniques
Al‐Shehari, T., & Shahzad, F. (2013) · International Journal of Computer Theory and Engineering · doi:10.7763/ijcte.2014.v6.837 · Cited by 29
Self-citationUsing PLSI-U to detect insider threats by datamining e-mail
Okolica, J. S., Peterson, G. L., & Mills, R. F. (2008) · International Journal of Security and Networks · doi:10.1504/ijsn.2008.017224 · Cited by 28
Detecting Insider Information Theft Using Features from File Access Logs
Gates, C. S., Li, N., Xu, Z., Chari, S. N., Molloy, I., & Park, Y. H. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11212-1_22 · Cited by 28
A Survey on Masquerader Detection Approaches
Bertacchini, M., & Fierens, P. I. (2009) · Cited by 27
Hanley, M., & Montelibano, J. (2011) · doi:10.21236/ada610463 · Cited by 27
5W1H-based Conceptual Modeling Framework for Domain Ontology and Its Application on STPO
Liu, Y., Hu, Z., Long, J., & Guo, T. (2011) · International Conference on Semantics, Knowledge and Grid (SKG) · doi:10.1109/skg.2011.31 · Cited by 23
Intelligence Analyses and the Insider Threat
Santos, E., Nguyen, H., Yu, F., Kim, K. J., Li, D., Wilkinson, J. T., Olson, A., Russell, J., & Clark, B. (2012) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/tsmca.2011.2162500 · Cited by 23
Database Intrusion Detection Using Role Profiling with Role Hierarchy
Wu, G. Z., Osborn, S. L., & Jin, X. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-04219-5_3 · Cited by 21
Hanley, M., & Montelibano, J. (2011) · KiltHub Repository · doi:10.1184/r1/6574472.v1 · Cited by 21
A Model-Based Approach to Predicting the Performance of Insider Threat Detection Systems
Roberts, S. C., Holodnak, J. T., Nguyen, T., Yuditskaya, S., Milosavljevic, M., & Streilein, W. W. (2016) · 2016 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2016.14 · Cited by 20
A Descriptive Literature Review and Classification of Insider Threat Research
Ophoff, J., Jensen, A., Sanderson-Smith, J., & Porter, M. (2014) · InSITE Conference · doi:10.28945/2010 · Cited by 18
Using instance-weighted naive Bayes for adapting concept drift in masquerade detection
Şen, S. (2014) · International Journal of Information Security · doi:10.1007/s10207-014-0238-9 · Cited by 14
A multi-perspective approach to insider threat detection
Raissi-Dehkordi, M., & Carr, D. (2011) · 2011 - MILCOM 2011 Military Communications Conference · doi:10.1109/milcom.2011.6127457 · Cited by 14
Detecting Masquerading Users in a Document Management System
Sankaranarayanan, V., Pramanik, S., & Upadhyaya, S. (2006) · International Conference on Communications · doi:10.1109/icc.2006.255112 · Cited by 12
Al‐Shehari, T., & Zhioua, S. (2018) · Cluster Computing · doi:10.1007/s10586-018-2817-4 · Cited by 11
Self-citationAn abnormal file access behavior detection approach based on file path diversity
Wang, X., Sun, Y., & Wang, Y. (2014) · doi:10.1049/cp.2014.0632 · Cited by 7
Lai, R. (2016) · DR-NTU (Nanyang Technological University) · Cited by 2
Abnormal File Access Behavior Detection Based on FPD: An Unsupervised Approach
Wang, X. B., Wang, Y. J., & Sun, Y. L. (2015) · Applied Mechanics and Materials · doi:10.4028/www.scientific.net/amm.713-715.2212 · Cited by 1
Deep Learning for Unsupervised Insider Threat Detection in Structured Cybersecurity Data Streams
Tuor, A., Kaplan, S., Hutchinson, B., Nichols, N., & Robinson, S. (2017) · arXiv · doi:10.48550/arxiv.1710.00811
Research works printed but not linked: 10
- cohen, 2009, Growing information: Part I, Proc Informing Sci Inf Technol (IISIT), 326
- 2016, Insider Threat Test Dataset
- schonlau, 2001, Masquerading User Dataset of Unix Command Line Sequences
- project, 2015, Enron Email Dataset
- laboratory, 2018, 1998 DARPA Intrusion Detection Evaluation Data Set
- 2018, Cost of Insider Threats? Global Sponsored by ObserveIT
- lee, 2019, IBM X-Force Threat Intelligence Index Report
- 2018, Threat Report 2018–C Technologies
- shaw, 1998, The insider threat to information systems, Security Awareness Bulletin, 2, 1
- homoliak, 2018, Insight into Insiders and IT: A Survey of Insider Threat Taxonomies, Analysis, Modeling, and Countermeasures, ACM Comput Surv, 52, 30
Cited by
Alzaabi, F. R., & Mehmood, A. (2024) · IEEE Access · doi:10.1109/access.2024.3369906 · Cited by 204
“The authors of [62] and [63] show that the effectiveness of these methods hinges on the quality of the baseline behavior models.”
BackgroundAl-Shehari, T., & Alsowail, R. A. (2021) · Entropy · doi:10.3390/e23101258 · Cited by 193
Self-citationCybersecurity Enterprises Policies: A Comparative Study
Mishra, A., Alzoubi, Y. I., Gill, A. Q., & Anwar, M. J. (2022) · Sensors · doi:10.3390/s22020538 · Cited by 149
Insider threat detection model using anomaly-based Isolation Forest algorithm
Al-Shehari, T., Al-Razgan, M., Alfakih, T., Alsowail, R. A., & Pandiaraj, S. (2023) · IEEE Access · doi:10.1109/access.2023.3326750 · Cited by 52
Self-citationAl-Shehari, T. A., Rosaci, D., Al-Razgan, M., Alfakih, T., Kadrie, M., Afzal, H., & Nawaz, R. (2024) · IEEE Access · doi:10.1109/access.2024.3373694 · Cited by 51
“The recent survey in [6] summarized the insider threat detection models in the literature.”
BackgroundSelf-citation
Metadata
- Authors
- Alsowail, R. A., & Al-Shehari, T.
- Affiliations
- King Saud University (SA)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 78385-78402
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3020736316
- Cited by
- 41
- References
- 76
- Citations by year
- 2026: 7 · 2025: 4 · 2024: 10 · 2023: 5 · 2022: 11 · 2021: 3 · 2020: 1
- FWCI
- 4.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Deanship of Scientific Research at King Saud University (RG-1441-401)
- Topics
- Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Keywords
- insider threats, insider threat detection, privileged access, classification methods, attack simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.