Explainable Anomaly and Intrusion Detection Intelligence for Platform Information Technology Using Dimensionality Reduction and Ensemble Learning
Abstract
Intrusion Detection Systems (IDS) for Platform Information Technology (PIT) Systems are deficient in capturing information, studies, assessments, research, and data for effectiveness. An IDS utilizes machine learning techniques to monitor cyber health, learn from malicious versus normal types of traffic, and implement automated protection measures for PIT systems. Ensemble learning is used for anomaly detection, malware detection, intrusion detection, and subtle or substantial changes in hardware or software. Ensemble learning can be used to differentiate static and dynamic commands, directives, and processes that are normal or abnormal by clustering similarities. This method assists with identification of abnormalities and grouping them. Dimensionality reduction minimizes the number of features currently being evaluated for selection. Principal Component Analysis (PCA) and Independent Component Analysis (ICA) is used to highlight the feature that is atypical in the test systems hardware and software baseline. These methods can be used for predictive and cyber health monitoring. Anomaly detection, identification, and discovery of PIT software resources, commands, and directives that have malicious intent. Ensemble learning and dimensionality reduction provide the foundation for an adaptable IDS that changes based on known (supervised) and unknown (unsupervised) environments, processes, programs, data, labels, and traffic. This paper proposes PCA, ICA, and ensemble learning methods for systematic use with PIT systems anomaly and intrusion detection intelligence. The trained IDS and cyber health model provides a software baseline for similar PIT systems. The IDS and preventative cyber health monitoring will be agnostic of the PIT system focusing on automatic test technology. Training the IDS and cyber health monitoring software on multiple PIT systems will provide research, data, and information that can be applied to these unique systems. The blending of normal and malicious behavior, processes, resources, and traffic provides information and data for changes in a PIT systems baseline configuration for even subtle deviations or changes in a systems hardware, software, or firmware. The continuous training, learning, and testing of the common agnostic intelligent anomaly detection and prevention tools provide system readiness to automatic test technology, cybersecurity health monitoring, and thorough detection of the slightest changes in normal system behavior. The application is expanded to include types of artificial neural networks, reinforcement learning, policy iteration, and value iteration in the future to advance the research and products for PIT systems.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · see citing works
Independent component analysis: algorithms and applications
Hyvärinen, A., & Erkki Oja, A. (2000) · Neural Networks · doi:10.1016/s0893-6080(00)00026-5 · Cited by 8,726 · see citing works
Independent Component Analysis
Hyvärinen, A., Hoyer, P. O., & Inki, M. (2004) · The MIT Press eBooks · doi:10.7551/mitpress/3717.003.0014 · Cited by 7,938 · see citing works
Anomaly-based network intrusion detection: Techniques, systems and challenges
García-Teodoro, P., Díaz-Verdejo, J., Maciá-Fernández, G., & Vázquez, E. (2009) · Computers & Security · doi:10.1016/j.cose.2008.08.003 · Cited by 2,085 · see citing works
Lever, J., Krzywinski, M. I., & Altman, N. (2017) · Nature Methods · doi:10.1038/nmeth.4346 · Cited by 1,468 · see citing works
Guide to Intrusion Detection and Prevention Systems (IDPS)
Scarfone, K. A., & Mell, P. M. (2007) · doi:10.6028/nist.sp.800-94 · Cited by 1,279 · see citing works
(2003) · Technometrics · doi:10.1198/tech.2003.s783 · Cited by 908 · see citing works
A Novel Anomaly Detection Scheme Based on Principal Component Classifier
Shyu, M., Chen, S., Sarinnapakorn, K., & Chang, L. (2003) · Cited by 602 · see citing works
Vidal, R., Ma, Y., & Sastry, S. (2016) · Interdisciplinary applied mathematics · doi:10.1007/978-0-387-87811-9_2 · Cited by 337 · see citing works
Raschka, S., & Mirjalili, V. (2017) · Cited by 245 · see citing works
Independent Component Analysis
Back, A. D. (2004) · Studies in fuzziness and soft computing · doi:10.1007/978-3-540-39972-8_3 · Cited by 120 · see citing works
Intrusion prevention system of automotive network CAN bus
Abbott-McCune, S., & Shay, L. A. (2016) · IEEE International Carnahan Conference on Security Technology (ICCST) · doi:10.1109/ccst.2016.7815711 · Cited by 40 · see citing works
Misuse detection for information retrieval systems
Cathey, R. J., Ma, L., Goharian, N., & Grossman, D. A. (2003) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/956863.956901 · Cited by 33 · see citing works
A network intrusion detection method using independent component analysis
Yang, D., & Qi, H. (2008) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2008.4761087 · Cited by 16 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A Survey on Explainable Anomaly Detection
Li, Z., Zhu, Y., & Van Leeuwen, M. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3609333 · Cited by 139 · see citing works
“To detect attacks in PIT systems, Morris [146] proposes to use Principal Component Analysis (PCA) or Independent Component Analysis (ICA) to reduce the number of”
MethodFinancial Abnormal Data Detection System Based on Reinforcement Learning
Hou, X. (2022) · Mobile Information Systems · doi:10.1155/2022/7358383 · Cited by 27 · see citing works
Explaining Machine Learning-Based Feature Selection of IDS for IoT and CPS Devices
Akintade, S., Kim, S., & Roy, K. (2023) · IFIP advances in information and communication technology · doi:10.1007/978-3-031-34107-6_6 · Cited by 7 · see citing works
Gao, Y., Miao, H., Chen, J., Song, B., Hu, X., & Wang, W. W. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2022.3160182 · Cited by 6 · see citing works
A DDoS Detection Method with Feature Set Dimension Reduction
Li, M., Qin, Y., & Zhou, H. (2022) · Communications in computer and information science · doi:10.1007/978-981-16-9576-6_25 · Cited by 3 · see citing works
- Authors
- Morris, B.
- Corresponding author
- Morris, Brian
- ORCID
- Morris, Brian
- Venue
- 2019 IEEE AUTOTESTCON
- Publisher
- IEEE
- Published
- 2019-08
- Pages
- 1-5
- ISSN
- 1088-7725 (ISSN-L)
- OpenAlex
- W2999656183
- Cited by
- 5
- References
- 14
- Citations by year
- 2023: 2 · 2022: 3
- FWCI
- 0.65
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE AUTOTESTCON (IEEE Systems Readiness Technology Conference) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
- Physical Sciences › Engineering › Biomedical Engineering › Artificial Immune Systems Applications
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- intrusion detection systems, anomaly detection, dimensionality reduction, principal component analysis, independent component analysis, ensemble learning, malware detection, explainable AI
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review