The DOI matches its Crossref record; 98 of the 98 references it cites were found in a registry or an index.
The rise of machine learning for detection and classification of malware: Research developments, trends and challenges
Open accessAbstract
The struggle between security analysts and malware developers is a never-ending battle with the complexity of malware changing as quickly as innovation grows. Current state-of-the-art research focus on the development and application of machine learning techniques for malware detection due to its ability to keep pace with malware evolution. This survey aims at providing a systematic and detailed overview of machine learning techniques for malware detection and in particular, deep learning techniques. The main contributions of the paper are: (1) it provides a complete description of the methods and features in a traditional machine learning workflow for malware detection and classification, (2) it explores the challenges and limitations of traditional machine learning and (3) it analyzes recent trends and developments in the field with special emphasis on deep learning approaches. Furthermore, (4) it presents the research issues and unsolved challenges of the state-of-the-art techniques and (5) it discusses the new directions of research. The survey helps researchers to have an understanding of the malware detection field and of the new developments and directions of research explored by the scientific community to tackle the problem.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Approximate nearest neighbors: towards removing the curse of dimensionality
Indyk, P., & Motwani, R. (1998) · Proceedings of the thirtieth annual ACM symposium on Theory of computing - STOC '98 · doi:10.1145/276698.276876 · Cited by 4,188
A survey on concept drift adaptation
Gama, J., Žliobaitė, I., Bifet, A., Pechenizkiy, M., & Bouchachia, A. (2014) · ACM Computing Surveys · doi:10.1145/2523813 · Cited by 3,735
(1998) · Cited by 3,476
The class imbalance problem: A systematic study1
Japkowicz, N., & Stephen, S. (2002) · Intelligent Data Analysis · doi:10.3233/ida-2002-6504 · Cited by 3,295
Character-level Convolutional Networks for Text Classification
Zhang, X., Zhao, J., & LeCun, Y. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.01626 · Cited by 3,205
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507
DDoS in the IoT: Mirai and Other Botnets
Kolias, C., Kambourakis, G., Stavrou, A., & Voas, J. (2017) · Computer · doi:10.1109/mc.2017.201 · Cited by 1,892
2011 International Joint Conference on Neural Networks
(2010) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2063350 · Cited by 1,469
Wild patterns: Ten years after the rise of adversarial machine learning
Biggio, B., & Roli, F. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2018.07.023 · Cited by 1,409
Nataraj, L., Karthikeyan, S., Jacob, G., & Manjunath, B. S. (2011) · doi:10.1145/2016904.2016908 · Cited by 1,223
Huang, L., Joseph, A. D., Nelson, B., Rubinstein, B. I. P., & Tygar, J. D. (2011) · Proceedings of the 4th ACM workshop on Security and artificial intelligence · doi:10.1145/2046684.2046692 · Cited by 1,194
Limits of Static Analysis for Malware Detection
Moser, A., Kruegel, C., & Kirda, E. (2007) · Twenty-Third Annual Computer Security Applications Conference (ACSAC 2007) · doi:10.1109/acsac.2007.21 · Cited by 813
Automatic analysis of malware behavior using machine learning
Rieck, K., Trinius, P., Willems, C., & Holz, T. (2011) · Journal of Computer Security · doi:10.3233/jcs-2010-0410 · Cited by 729
Dinaburg, A., Royal, P., Sharif, M., & Lee, W. (2008) · Proceedings of the ACM Conference on Computer and Communications Security · doi:10.1145/1455770.1455779 · Cited by 660
Practical Malware Analysis: The Hands-On Guide to Dissecting Malicious Software
Sikorski, M., & Honig, A. (2012) · CERN Document Server (European Organization for Nuclear Research) · Cited by 629
A Survey on Malware Detection Using Data Mining Techniques
Ye, Y., Li, T., Adjeroh, D., & Iyengar, S. S. (2018) · ACM Computing Surveys · doi:10.1145/3073559 · Cited by 623
Malware Obfuscation Techniques: A Brief Survey
You, I., & Yim, K. (2010) · 2010 International Conference on Broadband, Wireless Computing, Communication and Applications · doi:10.1109/bwcca.2010.85 · Cited by 607
Scalable, behavior-based malware clustering
Bayer, U. (2009) · Cited by 603
Laws of software evolution revisited
Lehman, M. M. (1996) · Lecture Notes in Computer Science · doi:10.1007/bfb0017737 · Cited by 572
Survey of machine learning techniques for malware analysis
Ucci, D., Aniello, L., & Baldoni, R. (2019) · Computers & Security · doi:10.1016/j.cose.2018.11.001 · Cited by 569
Deep Learning for Classification of Malware System Call Sequences
Kolosnjaji, B., Zarras, A., Webster, G., & Eckert, C. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-50127-7_11 · Cited by 515
On the Class Imbalance Problem
Guo, X., Yin, Y., Dong, C., Yang, G., & Zhou, G. (2008) · 2008 Fourth International Conference on Natural Computation · doi:10.1109/icnc.2008.871 · Cited by 495
2016 IEEE International Conference on Big Data (Big Data)
(2016) · doi:10.1109/bigdata38862.2016 · Cited by 451
Opcode sequences as representation of executables for data-mining-based unknown malware detection
Santos, I., Brezo, F., Ugarte-Pedrero, X., & Bringas, P. G. (2013) · Information Sciences · doi:10.1016/j.ins.2011.08.020 · Cited by 442
Large-scale malware classification using random projections and neural networks
Dahl, G. E., Stokes, J. W., Deng, L., & Yu, D. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6638293 · Cited by 439
A state-of-the-art survey of malware detection approaches using data mining techniques
Souri, A., & Hosseini, R. (2018) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-018-0125-x · Cited by 377
Using Entropy Analysis to Find Encrypted and Packed Malware
Lyda, R., & Hamrock, J. (2007) · IEEE Security and Privacy Magazine · doi:10.1109/msp.2007.48 · Cited by 371
Novel Feature Extraction, Selection and Fusion for Effective Malware Family Classification
Ahmadi, M., Ulyanov, D., Semenov, S., Trofimov, M., & Giacinto, G. (2016) · Proceedings of the Sixth ACM Conference on Data and Application Security and Privacy · doi:10.1145/2857705.2857713 · Cited by 359
AL-Hawawreh, M., Moustafa, N., & Sitnikova, E. (2018) · Journal of Information Security and Applications · doi:10.1016/j.jisa.2018.05.002 · Cited by 335
Shabtai, A., Moskovitch, R., Elovici, Y., & Glezer, C. (2009) · Information Security Technical Report · doi:10.1016/j.istr.2009.03.003 · Cited by 318
2016 International Joint Conference on Neural Networks (IJCNN)
(2016) · doi:10.1109/ijcnn38550.2016 · Cited by 303
A survey on heuristic malware detection techniques
Bazrafshan, Z., Hashemi, H., Fard, S. M. H., & Hamzeh, A. (2013) · The 5th Conference on Information and Knowledge Technology · doi:10.1109/ikt.2013.6620049 · Cited by 301
Graph-based malware detection using dynamic analysis
Anderson, B., Quist, D., Neil, J., Storlie, C., & Lane, T. (2011) · Journal in Computer Virology · doi:10.1007/s11416-011-0152-x · Cited by 296
Microsoft Malware Classification Challenge
Ronen, R., Radu, M., Feuerstein, C., Yom‐Tov, E., & Ahmadi, M. (2018) · arXiv (Cornell University) · doi:10.13140/rg.2.2.34695.91045 · Cited by 286
Malicious Software Classification Using Transfer Learning of ResNet-50 Deep Neural Network
Rezende, E., Ruppert, G., Carvalho, T., Ramos, F., & de Geus, P. (2017) · 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2017.00-19 · Cited by 285
Classification of malware based on integrated static and dynamic features
Islam, R., Tian, R., Batten, L. M., & Versteeg, S. (2013) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2012.10.004 · Cited by 270
Detecting unknown malicious code by applying classification techniques on OpCode patterns
Shabtai, A., Moskovitch, R., Feher, C., Dolev, S., & Elovici, Y. (2012) · Security Informatics · doi:10.1186/2190-8532-1-1 · Cited by 266
MtNet: A Multi-Task Neural Network for Dynamic Malware Classification
Huang, W., & Stokes, J. W. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-40667-1_20 · Cited by 262
Practical Malware Analysis: The Hands-On Guide to Dissecting Malicious Software
Mylonas, A., & Gritzalis, D. (2012) · Computers & Security · doi:10.1016/j.cose.2012.05.004 · Cited by 260
Using convolutional neural networks for classification of malware represented as images
Gibert, D., Mateu, C., Planes, J., & Vicens, R. (2019) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-018-0323-0 · Cited by 243
Self-citationMalware classification with LSTM and GRU language models and a character-level CNN
Athiwaratkun, B., & Stokes, J. W. (2017) · 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2017.7952603 · Cited by 239
AMAL: High-fidelity, behavior-based automated malware analysis and classification
Mohaisen, A., Alrawi, O., & Mohaisen, M. (2015) · Computers & Security · doi:10.1016/j.cose.2015.04.001 · Cited by 224
Obfuscation: The Hidden Malware
O'Kane, P., Sezer, S., & McLaughlin, K. (2011) · IEEE Security & Privacy · doi:10.1109/msp.2011.98 · Cited by 221
Malware images: visualization and automatic classification
Nataraj (2011) · (No Title) · Cited by 215
Behavior-based features model for malware detection
Galal, H. S., Mahdy, Y. B., & Atiea, M. A. (2015) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-015-0244-0 · Cited by 214
Exploring Adversarial Examples in Malware Detection
Suciu, O., Coull, S. E., & Johns, J. (2019) · 2019 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2019.00015 · Cited by 211
An intelligent PE-malware detection system based on association mining
Ye, Y., Wang, D., Li, T., Ye, D., & Jiang, Q. (2008) · Journal in Computer Virology · doi:10.1007/s11416-008-0082-4 · Cited by 193
Malware classification based on call graph clustering
Kinable, J., & Kostakis, O. (2011) · Journal in Computer Virology · doi:10.1007/s11416-011-0151-y · Cited by 192
Proceedings of the thirtieth annual ACM symposium on Theory of computing
Vitter, J. S. (1998) · Cited by 188
Adversarial Deep Learning for Robust Detection of Binary Encoded Malware
Al-Dujaili, A., Huang, A., Hemberg, E., & OReilly, U.-M. (2018) · 2018 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2018.00020 · Cited by 185
Unknown malware detection using network traffic classification
Bekerman, D., Shapira, B., Rokach, L., & Bar, A. (2015) · IEEE Conference on Communications and Network Security · doi:10.1109/cns.2015.7346821 · Cited by 176
Malware detection based on mining API calls
Sami, A., Yadegari, B., Rahimi, H., Peiravian, N., Hashemi, S., & Hamze, A. (2010) · Proceedings of the 2010 ACM Symposium on Applied Computing · doi:10.1145/1774088.1774303 · Cited by 174
Image visualization based malware detection
Kancherla, K., & Mukkamala, S. (2013) · IEEE Symposium on Computational Intelligence in Cyber Security (CICS) · doi:10.1109/cicybs.2013.6597204 · Cited by 163
An investigation of byte n-gram features for malware classification
Raff, E., Zak, R., Cox, R., Sylvester, J., Yacci, P., Ward, R., Tracy, A., McLean, M., & Nicholas, C. (2018) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-016-0283-1 · Cited by 160
Proceedings of the 16th ACM conference on Computer and communications security
Al‐Shaer, E., Jha, S., & Keromytis, A. D. (2009) · doi:10.1145/1653662 · Cited by 152
Han, W., Xue, J., Wang, Y., Huang, L., Kong, Z., & Mao, L. (2019) · Computers & Security · doi:10.1016/j.cose.2019.02.007 · Cited by 151
Malware detection based on deep learning algorithm
Yuxin, D., & Zhu, S. (2017) · Neural Computing and Applications · doi:10.1007/s00521-017-3077-6 · Cited by 150
Adversarial Machine Learning in Malware Detection: Arms Race between Evasion Attack and Defense
Chen, L., Ye, Y., & Bourlai, T. (2017) · European Intelligence and Security Informatics Conference · doi:10.1109/eisic.2017.21 · Cited by 146
Structural entropy and metamorphic malware
Baysa, D., Low, R. M., & Stamp, M. (2013) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-013-0185-4 · Cited by 144
Towards Adversarial Malware Detection: Lessons Learned from PDF-based Attacks
Maiorca, D., Biggio, B., & Giacinto, G. (2019) · ACM Computing Surveys · doi:10.1145/3332184 · Cited by 129
Artificial Neural Networks and Machine Learning – ICANN 2018
(2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01424-7 · Cited by 126
Proceedings of the 1995 ACM symposium on Applied computing - SAC '95
(1995) · doi:10.1145/315891 · Cited by 123
The rise of “malware”: Bibliometric analysis of malware study
Razak, M. F. A., Anuar, N. B., Salleh, R., & Firdaus, A. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.08.022 · Cited by 120
Unknown malcode detection via text categorization and the imbalance problem
Moskovitch, R., Stopel, D., Feher, C., Nissim, N., & Elovici, Y. (2008) · IEEE International Conference on Intelligence and Security Informatics (ISI) · doi:10.1109/isi.2008.4565046 · Cited by 118
Scalable Function Call Graph-based Malware Classification
Hassen, M., & Chan, P. K. (2017) · ACM Conference on Data and Application Security and Privacy (CODASPY) · doi:10.1145/3029806.3029824 · Cited by 115
(2018) · arXiv (Cornell University) · Cited by 113
The promise of machine learning in cybersecurity
Fraley, J. B., & Cannady, J. (2017) · IEEE SoutheastCon · doi:10.1109/secon.2017.7925283 · Cited by 109
MalInsight: A systematic profiling based malware detection framework
Han, W., Xue, J., Wang, Y., Liu, Z., & Kong, Z. (2018) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2018.10.022 · Cited by 104
MutantX-S: scalable malware clustering based on static features
Hu, X. Y., Bhatkar, S., Griffin, K., & Shin, K. G. (2013) · Cited by 98
Approaches to adversarial drift
Kantchelian, A., Afroz, S., Huang, L., Islam, A. C., Miller, B., Tschantz, M. C., Greenstadt, R., Joseph, A. D., & Tygar, J. D. (2013) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/2517312.2517320 · Cited by 96
SBMDS: an interpretable string based malware detection system using SVM ensemble with bagging
Ye, Y., Chen, L., Wang, D., Li, T., Jiang, Q., & Zhao, M. (2008) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-008-0108-y · Cited by 96
Salehi, Z., Sami, A., & Ghiasi, M. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.12.016 · Cited by 89
Classification of Malware by Using Structural Entropy on Convolutional Neural Networks
Gibert, D., Mateu, C., Planes, J., & Vicens, R. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11409 · Cited by 85
Self-citationEmpowering convolutional networks for malware classification and analysis
Kolosnjaji, B., Eraisha, G., Webster, G., Zarras, A., & Eckert, C. M. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966340 · Cited by 84
Proceedings of the Sixth ACM Conference on Data and Application Security and Privacy
Zarras, A., Kohls, K., Dürmuth, M., & Pöpper, C. (2016) · doi:10.1145/2857705 · Cited by 83
Deep Neural Network Based Malware Detection Using Two Dimensional Binary Program FeaturesPreprint
Saxe, J., & Berlin, K. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.03096 · Cited by 81
Proceedings of the 4th ACM workshop on Security and artificial intelligence
Chen, Y., Cárdenas, Á. A., Greenstadt, R., & Rubinstein, B. (2011) · doi:10.1145/2046684 · Cited by 80
Network malware classification comparison using DPI and flow packet headers
Boukhtouta, A., Mokhov, S. A., Lakhdari, N.-E., Debbabi, M., & Paquet, J. (2015) · Journal of Computer Virology and Hacking Techniques · doi:10.1007/s11416-015-0247-x · Cited by 66
Mining control flow graph as API call-grams to detect portable executable malware
Faruki, P., Laxmi, V., Gaur, M. S., & Vinod, P. (2012) · International Conference on Security of Information and Networks (SIN) · doi:10.1145/2388576.2388594 · Cited by 58
The 5th Conference on Information and Knowledge Technology
(2013) · doi:10.1109/ikt31279.2013 · Cited by 50
Džeroski, S., Ceci, M., Žitnik, M., Read, J., Stefanowski, J., Malerba, D., Mielikäinen, T., Das, K., & Altün, Y. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71273-4 · Cited by 47
Wavelet decomposition of software entropy reveals symptoms of malicious code
Wojnowicz, M., Chisholm, G., Wolff, M., & Zhao, X. (2016) · Journal of Innovation in Digital Ecosystems · doi:10.1016/j.jides.2016.10.009 · Cited by 46
The Effects of Traditional Anti-Virus Labels on Malware Detection Using Dynamic Runtime Opcodes
Carlin, D., Cowan, A., O’Kane, P., & Sezer, S. (2017) · IEEE Access · doi:10.1109/access.2017.2749538 · Cited by 39
Malware Detection by Analysing Encrypted Network Traffic with Neural Networks
Prasse, P., Machlica, L., Pevný, T., Havelka, J., & Scheffer, T. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-71246-8_5 · Cited by 34
Computer Networks and Intelligent Computing
Venugopal, K. R., & Patnaik, L. M. (2011) · Communications in computer and information science · doi:10.1007/978-3-642-22786-8 · Cited by 33
Behavior analysis of malware using machine learning
Dhammi, A., & Singh, M. (2015) · International Conference on Contemporary Computing · doi:10.1109/ic3.2015.7346730 · Cited by 31
Stochastic identification of malware with dynamic traces
Storlie, C. B., Anderson, B., Wiel, S. V., Quist, D., Hash, C., & Brown, N. (2014) · The Annals of Applied Statistics · doi:10.1214/13-aoas703 · Cited by 21
A study on interpretability of decision of machine learning
Shirataki, S., & Yamaguchi, S. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258557 · Cited by 19
LAB to SOC: Robust Features for Dynamic Malware Detection
Rhode, M., Tuson, L., Burnap, P., & Jones, K. (2019) · doi:10.1109/dsn-industry.2019.00010 · Cited by 17
Cited by
A comprehensive survey on deep learning based malware detection techniques
M., G., & Sethuraman, S. C. (2023) · Computer Science Review · doi:10.1016/j.cosrev.2022.100529 · Cited by 277
Lin, S.-S., Shen, S.-L., Zhou, A., & Xu, Y.-S. (2021) · Automation in Construction · doi:10.1016/j.autcon.2020.103490 · Cited by 271
A survey on machine learning-based malware detection in executable files
Singh, J., & Singh, J. (2021) · Journal of Systems Architecture · doi:10.1016/j.sysarc.2020.101861 · Cited by 254
A review of state-of-the-art malware attack trends and defense mechanisms
Ferdous, J., Islam, R., Mahboubi, A., & Islam, M. Z. (2023) · IEEE Access · doi:10.1109/access.2023.3328351 · Cited by 98
STSIR: An individual-group game-based model for disclosing virus spread in Social Internet of Things
Wu, G., Xie, L., Zhang, H., Wang, J., Shen, S., & Yu, S. (2023) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2023.103608 · Cited by 72
Metadata
- Authors
- Gibert, D., Mateu, C., & Planes, J.
- Venue
- Journal of Network and Computer Applications
- Publisher
- Elsevier BV
- Published
- 2020-03
- Volume
- 153
- Pages
- 102526
- ISSN
- 1084-8045 (ISSN-L)
- OpenAlex
- W2996806689
- Cited by
- 619
- References
- 98
- FWCI
- 50.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.