The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Detecting unknown malicious code by applying classification techniques on OpCode patterns
Open accessAbstract
In previous studies classification algorithms were employed successfully for the detection of unknown malicious code. Most of these studies extracted features based on byte n-gram patterns in order to represent the inspected files. In this study we represent the inspected files using OpCode n-gram patterns which are extracted from the files after disassembly. The OpCode n -gram patterns are used as features for the classification process. The classification process main goal is to detect unknown malware within a set of suspected files which will later be included in antivirus software as signatures. A rigorous evaluation was performed using a test collection comprising of more than 30,000 files, in which various settings of OpCode n -gram patterns of various size representations and eight types of classifiers were evaluated. A typical problem of this domain is the imbalance problem in which the distribution of the classes in real life varies. We investigated the imbalance problem, referring to several real-life scenarios in which malicious files are expected to be about 10% of the total inspected files. Lastly, we present a chronological evaluation in which the frequent need for updating the training set was evaluated. Evaluation results indicate that the evaluated methodology achieves a level of accuracy higher than 96% (with TPR above 0.95 and FPR approximately 0.1), which slightly improves the results in previous studies that use byte n -gram representation. The chronological evaluation showed a clear trend in which the performance improves as the training set is more updated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Neural Networks for Pattern Recognition
Bishop, C. M. (1995) · doi:10.1093/oso/9780198538493.001.0001 · Cited by 12,287
Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., et al. (1999) · Science · doi:10.1126/science.286.5439.531 · Cited by 11,516
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
A vector space model for automatic indexing
Salton, G., Wong, A., & Yang, C. S. (1975) · Communications of the ACM · doi:10.1145/361219.361220 · Cited by 7,521 · cited 2×
“The TF and TFIDF are well known measures in the text categorization field [39].”
BackgroundMethodApplied Linear Statistical Models.
Lorenz, F., Neter, J., Wasserman, W., & Kutner, M. H. (1986) · Journal of the American Statistical Association · doi:10.2307/2289108 · Cited by 5,565
Ho, T. K. (2002) · Proceedings of 3rd International Conference on Document Analysis and Recognition · doi:10.1109/icdar.1995.598994 · Cited by 5,054
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss
Domingos, P., & Pazzani, M. (1997) · Machine Learning · doi:10.1023/a:1007413511361 · Cited by 3,101
2009 International Joint Conference on Artificial Intelligence
(2009) · doi:10.1109/jcai15434.2009 · Cited by 2,800
Addressing the Curse of Imbalanced Training Sets: One-Sided Selection.
Kubát, M., & Matwin, S. (1997) · Cited by 2,230
Editorial: special issue on learning from imbalanced data sets
Chawla, N. V., Japkowicz, N., & Kotcz, A. (2004) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1007730.1007733 · Cited by 2,063
Making Large-Scale Support Vector Machine Learning Practical
Joachims, T. (1998) · Advances in Kernel Methods · doi:10.7551/mitpress/1130.003.0015 · Cited by 1,613
A brief introduction to boosting
Schapire, R. E. (1999) · International Joint Conference on Artificial Intelligence · Cited by 1,572
Robust classification for imprecise environments
Provost, F., & Fawcett, T. (2001) · Machine Learning · doi:10.1023/a:1007601015854 · Cited by 1,250
Machine Learning for the Detection of Oil Spills in Satellite Radar Images
Kubat, M., Holte, R. C., & Matwin, S. (1998) · Machine Learning · doi:10.1023/a:1007452223027 · Cited by 1,243
Data mining methods for detection of new malicious executables
Schultz, M. G., Eskin, E., Zadok, F., & Stolfo, S. J. (2002) · Proceedings 2001 IEEE Symposium on Security and Privacy. S&P 2001 · doi:10.1109/secpri.2001.924286 · Cited by 1,067
A framework for constructing features and models for intrusion detection systems
Lee, W., & Stolfo, S. J. (2000) · ACM Transactions on Information and System Security · doi:10.1145/382912.382914 · Cited by 974
Learning when training data are costly: the effect of class distribution on tree induction
Weiss, G. M., & Provost, F. (2003) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1199 · Cited by 921
Limits of Static Analysis for Malware Detection
Moser, A., Kruegel, C., & Kirda, E. (2007) · Twenty-Third Annual Computer Security Applications Conference (ACSAC 2007) · doi:10.1109/acsac.2007.21 · Cited by 813
Advances in Kernel Methods: Support Vector Learning
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/1130.001.0001 · Cited by 761
Dinaburg, A., Royal, P., Sharif, M., & Lee, W. (2008) · Proceedings of the ACM Conference on Computer and Communications Security · doi:10.1145/1455770.1455779 · Cited by 660
Obfuscation of executable code to improve resistance to static disassembly
Linn, C., & Debray, S. (2003) · Proceedings of the 10th ACM conference on Computer and communications security · doi:10.1145/948109.948149 · Cited by 602
Learning and Classification of Malware Behavior
Rieck, K., Holz, T., Willems, C., Düssel, P., & Laskov, P. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-70542-0_6 · Cited by 589
Security and Communication Networks
(2018) · Security and Communication Networks · doi:10.1002/(issn)1939-0122 · Cited by 564
Learning to Detect and Classify Malicious Executables in the Wild
Kolter, J. Z., & Maloof, M. A. (2006) · doi:10.5555/1248547.1248646 · Cited by 562
Automated Classification and Analysis of Internet Malware
Bailey, M., Oberheide, J., Andersen, J. H., Mao, Z. M., Jahanian, F., & Nazario, J. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74320-0_10 · Cited by 531
Learning to detect malicious executables in the wild
Kolter, J. Z., & Maloof, M. A. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014105 · Cited by 475
Morik, K. J., Brockhausen, P., & Joachims, T. (1999) · RePEc: Research Papers in Economics · Cited by 350
Shabtai, A., Moskovitch, R., Elovici, Y., & Glezer, C. (2009) · Information Security Technical Report · doi:10.1016/j.istr.2009.03.003 · Cited by 318
Self-citationOpcodes as predictor for malware
Bilar, D. (2007) · International Journal of Electronic Security and Digital Forensics · doi:10.1504/ijesdf.2007.016865 · Cited by 302
PolyUnpack: Automating the Hidden-Code Extraction of Unpack-Executing Malware
Royal, P., Halpin, M., Dagon, D., Edmonds, R., & Lee, W. (2006) · 2006 22nd Annual Computer Security Applications Conference (ACSAC'06) · doi:10.1109/acsac.2006.38 · Cited by 293
N-gram-based detection of new malicious code
Abou-Assaleh, T., Cercone, N., Keselj, V., & Sweidan, R. (2004) · Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004. · doi:10.1109/cmpsac.2004.1342667 · Cited by 280
Malware phylogeny generation using permutations of code
Karim, M. E., Walenstein, A., Lakhotia, A., & Parida, L. (2005) · Journal in Computer Virology · doi:10.1007/s11416-005-0002-9 · Cited by 229
Automatic Generation of String Signatures for Malware Detection
Griffin, K., Schneider, S., Hu, X., & Chiueh, T.-C. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-04342-0_6 · Cited by 218
Unknown Malcode Detection Using OPCODE Representation
Moskovitch, R., Feher, C., Tzachar, N., Berger, E., Gitelman, M., Dolev, S., & Elovici, Y. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-89900-6_21 · Cited by 199
Self-citationPerdisci, R., Lanzi, A., & Lee, W. (2008) · Annual Computer Security Applications Conference · doi:10.1109/acsac.2008.22 · Cited by 156
Improving malware detection by applying multi-inducer ensemble
Menahem, E., Shabtai, A., Rokach, L., & Elovici, Y. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2008.10.015 · Cited by 140
Self-citationRobust classification systems for imprecise environments
Provost, F. J., & Fawcett, T. E. (1998) · Cited by 119
Detection of unknown computer worms based on behavioral classification of the host
Moskovitch, R., Elovici, Y., & Rokach, L. (2008) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2008.01.028 · Cited by 105
Self-citationAnnual Computer Security Applications Conference
(2020) · doi:10.1145/3427228 · Cited by 97
Unknown malcode detection and the imbalance problem
Moskovitch, R., Stopel, D., Feher, C., Nissim, N., Japkowicz, N., & Elovici, Y. (2009) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-009-0122-8 · Cited by 69
Self-citationArtificial Intelligence and Applications
Rozario, L. J., Haque, M., & Uddin, M. (2015) · Artificial Intelligence and Applications · doi:10.15764/aia.2015.01001 · Cited by 56
Malware prevalence in the KaZaA file-sharing network
Shin, S., Jung, J., & Balakrishnan, H. (2006) · Proceedings of the 6th ACM SIGCOMM conference on Internet measurement · doi:10.1145/1177080.1177125 · Cited by 49
Comparison of feature selection and classification algorithms in identifying malicious executables
Cai, D. M., Gokhale, M. B., & Theiler, J. P. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.09.005 · Cited by 21
Shabtai, A., Potashnik, D., Fledel, Y., Moskovitch, R., & Elovici, Y. (2010) · Security and Communication Networks · doi:10.1002/sec.229 · Cited by 21
Self-citationArtificial Intelligence and Applications
(2022) · doi:10.5121/csit.2022.1209 · Cited by 18
Cited by
Gibert, D., Mateu, C., & Planes, J. (2020) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.102526 · Cited by 619
A Survey on Machine Learning Techniques for Cyber Security in the Last Decade
Shaukat, K., Luo, S., Varadharajan, V., Hameed, I. A., & Xu, M. (2020) · IEEE Access · doi:10.1109/access.2020.3041951 · Cited by 530
A Systematic Review on Imbalanced Data Challenges in Machine Learning: Applications and Solutions
Kaur, H., Pannu, H. S., & Malhi, A. K. (2020) · ACM Computing Surveys · doi:10.1145/3343440 · Cited by 488
Image-Based malware classification using ensemble of CNN architectures (IMCEC)
Vasan, D., Alazab, M., Wassan, S., Safaei, B., & Zheng, Q. (2020) · Computers & Security · doi:10.1016/j.cose.2020.101748 · Cited by 401
Robust Malware Detection for Internet of (Battlefield) Things Devices Using Deep Eigenspace Learning
Azmoodeh, A., Dehghantanha, A., & Choo, K.-K. R. (2019) · IEEE Transactions on Sustainable Computing · doi:10.1109/tsusc.2018.2809665 · Cited by 378
Metadata
- Authors
- Shabtai, A., Moskovitch, R., Feher, C., Dolev, S., & Elovici, Y.
- Venue
- Security Informatics
- Published
- 2012-02-27
- Volume
- 1
- Issue
- 1
- ISSN
- 2190-8532 (ISSN-L)
- OpenAlex
- W2150188172
- Cited by
- 266
- References
- 50
- FWCI
- 25.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.