The DOI matches its Crossref record; 81 of the 81 references it cites were found in a registry or an index.
Software Vulnerability Analysis and Discovery Using Machine-Learning and Data-Mining Techniques: A Survey
Abstract
Software security vulnerabilities are one of the critical issues in the realm of computer security. Due to their potential high severity impacts, many different approaches have been proposed in the past decades to mitigate the damages of software vulnerabilities. Machine-learning and data-mining techniques are also among the many approaches to address this issue. In this article, we provide an extensive review of the many different works in the field of software vulnerability analysis and discovery that utilize machine-learning and data-mining techniques. We review different categories of works in this domain, discuss both advantages and shortcomings, and point out challenges and some uncharted territories in the field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
Artificial intelligence: a modern approach
(1995) · Choice Reviews Online · doi:10.5860/choice.33-1577 · Cited by 21,974
Chandola, V., Banerjee, A., & Kumar, V. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541882 · Cited by 11,687
Artificial intelligence: A modern approach
Nilsson, N. J. (1996) · Artificial Intelligence · doi:10.1016/0004-3702(96)00007-0 · Cited by 10,583
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326
Outside the Closed World: On Using Machine Learning for Network Intrusion Detection
Sommer, R., & Paxson, V. (2010) · 2010 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2010.25 · Cited by 2,085
Anomaly-based network intrusion detection: Techniques, systems and challenges
García-Teodoro, P., Díaz-Verdejo, J., Maciá-Fernández, G., & Vázquez, E. (2009) · Computers & Security · doi:10.1016/j.cose.2008.08.003 · Cited by 2,085
Graph based anomaly detection and description: a survey
Akoglu, L., Tong, H., & Koutra, D. (2015) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-014-0365-y · Cited by 1,504
IEEE Standard Glossary of Software Engineering Terminology
(2008) · doi:10.1109/ieeestd.1990.101064 · Cited by 979
Modeling and Discovering Vulnerabilities with Code Property Graphs
Yamaguchi, F., Golde, N., Arp, D., & Rieck, K. (2014) · 2014 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2014.44 · Cited by 808
Bugs as deviant behavior: a general approach to inferring errors in systems code
Engler, D., Chen, D. Y., Hallem, S., Chou, A., & Chelf, B. (2001) · Proceedings of the eighteenth ACM symposium on Operating systems principles · doi:10.1145/502034.502041 · Cited by 737
A few billion lines of code later: using static analysis to find bugs in the real world
Bessey, A., Block, K., Chelf, B., Chou, A., Fulton, B., Hallem, S., Henri-Gros, C., Kamsky, A., McPeak, S., & Engler, D. (2010) · Communications of the ACM · doi:10.1145/1646353.1646374 · Cited by 635
A systematic review of machine learning techniques for software fault prediction
Malhotra, R. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2014.11.023 · Cited by 620
Shin, Y., Meneely, A., Williams, L., & Osborne, J. A. (2011) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.81 · Cited by 607
Comprehensible classification models: a position paper
Freitas, A. A. (2014) · ACM SIGKDD Explorations Newsletter · doi:10.1145/2594473.2594475 · Cited by 572
SAGE: whitebox fuzzing for security testing
Godefroid, P., Levin, M. Y., & Molnar, D. (2012) · Communications of the ACM · doi:10.1145/2093548.2093564 · Cited by 567
A review of machine learning approaches to Spam filtering
Guzella, T. S., & Caminhas, W. M. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.02.037 · Cited by 542
Using Static Analysis to Find Bugs
Ayewah, N., Pugh, W., Hovemeyer, D., Morgenthaler, J. D., & Penix, J. (2008) · IEEE Software · doi:10.1109/ms.2008.130 · Cited by 534
A systematic review of software fault prediction studies
Catal, C., & Diri, B. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.10.027 · Cited by 530
Automatic patch generation by learning correct code
Long, F., & Rinard, M. (2016) · Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages · doi:10.1145/2837614.2837617 · Cited by 481
Transfer learning for cross-company software defect prediction
Ma, Y., Luo, G., Zeng, X., & Chen, A. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.007 · Cited by 475
Nam, J., Pan, S. J., & Kim, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606584 · Cited by 449
Li, Z., & Zhou, Y. (2005) · Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1081706.1081755 · Cited by 428
Jhala, R., & Majumdar, R. (2009) · ACM Computing Surveys · doi:10.1145/1592434.1592438 · Cited by 418
Undecidability of static analysis
Landi, W. A. (1992) · ACM Letters on Programming Languages and Systems · doi:10.1145/161494.161501 · Cited by 407
A survey of coordinated attacks and collaborative intrusion detection
Zhou, C. V., Leckie, C., & Karunasekera, S. (2010) · Computers & Security · doi:10.1016/j.cose.2009.06.008 · Cited by 374
Deep Learning for Just-in-Time Defect Prediction
Yang, X., Lo, D., Xia, X., Zhang, Y., & Sun, J. (2015) · 2015 IEEE International Conference on Software Quality, Reliability and Security · doi:10.1109/qrs.2015.14 · Cited by 352
GRAPH MATCHING AND LEARNING IN PATTERN RECOGNITION IN THE LAST 10 YEARS
FOGGIA, P., PERCANNELLA, G., & VENTO, M. (2014) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001414500013 · Cited by 337
Predicting Vulnerable Software Components via Text Mining
Scandariato, R., Walden, J., Hovsepyan, A., & Joosen, W. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2340398 · Cited by 337
DynaMine: finding common error patterns by mining software revision histories
Livshits, B., & Zimmermann, T. (2005) · Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1081706.1081754 · Cited by 330
SAGE: Whitebox Fuzzing for Security Testing: SAGE has had a remarkable impact at Microsoft.
Godefroid, P., Levin, M. Y., & Molnar, D. (2012) · Queue · doi:10.1145/2090147.2094081 · Cited by 328
Software vulnerability analysis
Krsul, I., & Spafford, E. H. (1998) · Cited by 286
Nam, J., Pan, S. J., & Kim, S. (2014) · Cited by 282
Detecting object usage anomalies
Wasylkowski, A., Zeller, A., & Lindig, C. (2007) · Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering · doi:10.1145/1287624.1287632 · Cited by 272
Arkin, B., Stender, S., & McGraw, G. (2005) · IEEE Security and Privacy Magazine · doi:10.1109/msp.2005.23 · Cited by 264
Mining API patterns as partial orders from source code: from usage scenarios to specifications
Acharya, M., Xie, T., Pei, J., & Xu, J. (2007) · Proceedings of the the 6th joint meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering · doi:10.1145/1287624.1287630 · Cited by 261
Software Engineering Metrics: What Do They Measure and How Do We Know?
Kaner, C., & Bond, W. P. (2004) · Cited by 256
Toward Large-Scale Vulnerability Discovery using Machine Learning
Grieco, G., Grinblat, G. L., Uzal, L., Rawat, S., Feist, J., & Mounier, L. (2016) · Proceedings of the Sixth ACM Conference on Data and Application Security and Privacy · doi:10.1145/2857705.2857720 · Cited by 238
VCCFinder: Finding Potential Vulnerabilities in Open-Source Projects to Assist Code Audits
Perl, H., Dechand, S., Smith, M., Arp, D., Yamaguchi, F., Rieck, K., Fahl, S., & Acar, Y. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813604 · Cited by 229
Generalized vulnerability extrapolation using abstract syntax trees
Yamaguchi, F., Lottmann, M., & Rieck, K. (2012) · Proceedings of the 28th Annual Computer Security Applications Conference · doi:10.1145/2420950.2421003 · Cited by 229
Juliet 1.1 C/C++ and Java Test Suite
Boland, T., & Black, P. E. (2012) · Computer · doi:10.1109/mc.2012.345 · Cited by 209
Searching for a Needle in a Haystack: Predicting Security Vulnerabilities for Windows Vista
Zimmermann, T., Nagappan, N., & Williams, L. (2010) · 2010 Third International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2010.32 · Cited by 205
Can traditional fault prediction models be used for vulnerability prediction?
Shin, Y., & Williams, L. (2013) · Empirical Software Engineering · doi:10.1007/s10664-011-9190-8 · Cited by 202
MAPO: mining API usages from open source repositories
Xie, T., & Pei, J. (2006) · Proceedings of the 2006 international workshop on Mining software repositories · doi:10.1145/1137983.1137997 · Cited by 201
Predicting Vulnerable Components: Software Metrics vs Text Mining
Walden, J., Stuckman, J., & Scandariato, R. (2014) · 2014 IEEE 25th International Symposium on Software Reliability Engineering · doi:10.1109/issre.2014.32 · Cited by 200
Khoshgoftaar, T. M., Allen, E. B., Hudepohl, J. P., & Aud, S. J. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.595888 · Cited by 198
Automatic Inference of Search Patterns for Taint-Style Vulnerabilities
Yamaguchi, F., Maier, A., Gascon, H., & Rieck, K. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.54 · Cited by 189
Bishop, M. (2007) · IEEE Security & Privacy · doi:10.1109/msp.2007.159 · Cited by 161
Chucky: exposing missing checks in source code for vulnerability discovery
Yamaguchi, F., Wressnegger, C., Gascon, H., & Rieck, K. (2013) · Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security - CCS '13 · doi:10.1145/2508859.2516665 · Cited by 161
The Art of Software Security Assessment: Identifying and Preventing Software Vulnerabilities
Dowd, M., McDonald, J., & Schuh, J. (2006) · CERN Document Server (European Organization for Nuclear Research) · Cited by 157
Mitigating program security vulnerabilities: Approaches and challenges
Shahriar, H., & Zulkernine, M. (2012) · ACM Computing Surveys · doi:10.1145/2187671.2187673 · Cited by 147
Building Program Vector Representations for Deep Learning
Peng, H. M., Mou, L., Li, G., Liu, Y., Zhang, L., & Jin, Z. G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25159-2_49 · Cited by 145
Web Application Vulnerability Prediction Using Hybrid Program Analysis and Machine Learning
Shar, L. K., Briand, L., & Tan, H. B. K. (2014) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2014.2373377 · Cited by 145
Vulnerability extrapolation: assisted discovery of vulnerabilities using machine learning
Yamaguchi, F., Lindner, F., & Rieck, K. (2011) · Cited by 138
Identifying the characteristics of vulnerable code changes: an empirical study
Bosu, A., Carver, J. C., Hafiz, M., Hilley, P., & Janni, D. (2014) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2635868.2635880 · Cited by 138
Challenges with applying vulnerability prediction models
Morrison, P. J., Herzig, K., Murphy, T. B., & Williams, L. A. (2015) · Symposium and Bootcamp on Science of Security · doi:10.1145/2746194.2746198 · Cited by 136
Challenging the anomaly detection paradigm: a provocative discussion
Gates, C. E., & Taylor, C. (2006) · New Security Paradigms Workshop · doi:10.1145/1278940.1278945 · Cited by 122
A survey of emerging approaches to spam filtering
Caruana, G., & Li, M. (2008) · ACM Computing Surveys · doi:10.1145/2089125.2089129 · Cited by 99
When a Patch Goes Bad: Exploring the Properties of Vulnerability-Contributing Commits
Meneely, A., Srinivasan, H., Musa, A., Tejeda, A. R., Mokary, M., & Spates, B. (2013) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2013.19 · Cited by 98
Larus, J. R., Ball, T., Das, M., DeLine, R. A., Fähndrich, M. A., Pincus, J., Rajamani, S. K., & Venkatapathy, R. (2004) · IEEE Software · doi:10.1109/ms.2004.1293079 · Cited by 97
Gruska, N., Wasylkowski, A., & Zeller, A. (2010) · International Symposium on Software Testing and Analysis · doi:10.1145/1831708.1831723 · Cited by 95
Medeiros, I., Neves, N., & Correia, M. P. (2014) · International World Wide Web Conference (WWW) · doi:10.1145/2566486.2568024 · Cited by 91
Godefroid, P. (2007) · doi:10.1145/1292414.1292416 · Cited by 90
A Survey of Clustering Algorithms for Graph Data
Aggarwal, C. C., & Wang, H. (2010) · The Kluwer international series on advances in database systems · doi:10.1007/978-1-4419-6045-0_9 · Cited by 90
Predicting Vulnerable Software Components through N-Gram Analysis and Statistical Feature Selection
Pang, Y., Xue, X., & Namin, A. S. (2015) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2015.99 · Cited by 89
Improving vulnerability discovery models
Ozment, A. (2007) · doi:10.1145/1314257.1314261 · Cited by 78
Comprehensible software fault and effort prediction: A data mining approach
Moeyersoms, J., de Fortuny, E. J., Dejaeger, K., Baesens, B., & Martens, D. (2014) · Journal of Systems and Software · doi:10.1016/j.jss.2014.10.032 · Cited by 75
Some Vulnerabilities Are Different Than Others
Nayak, K., Marino, D., Efstathopoulos, P., & Dumitraş, T. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11379-1_21 · Cited by 74
Seeing the Forest Through the Trees: Learning a Comprehensible Model from an Ensemble
Assche, A. V., & Blockeel, H. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_39 · Cited by 74
Discovering Neglected Conditions in Software by Mining Dependence Graphs
Chang, R.-Y., Podgurski, A., & Yang, J. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.24 · Cited by 72
Artificial intelligence and the future of cybersecurity
Morel, B. (2011) · ACM Workshop on Artificial Intelligence and Security (AISec) · doi:10.1145/2046684.2046699 · Cited by 68
Mining Bug Databases for Unidentified Software Vulnerabilities
Wijayasekara, D., Manic, M., Wright, J. L., & McQueen, M. (2012) · Conference on Human System Interactions · doi:10.1109/hsi.2012.22 · Cited by 61
Artificial intelligence in cyber defense
Tyugu, E. (2011) · International Conference on Cyber Conflict · Cited by 58
Strengthening the empirical analysis of the relationship between Linus' Law and software security
Meneely, A., & Williams, L. A. (2010) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1145/1852786.1852798 · Cited by 57
Predicting Vulnerable Components via Text Mining or Software Metrics? An Effort-Aware Perspective
Tang, Y., Zhao, F., Yang, Y., Lu, H., Zhou, Y., & Xu, B. (2015) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2015.15 · Cited by 36
Zeller, A., Zimmermann, T., & Bird, C. (2011) · doi:10.1145/2020390.2020395 · Cited by 28
Cybersecurity and Artificial Intelligence: From Fixing the Plumbing to Smart Water
Landwehr, C. E. (2008) · IEEE Security & Privacy · doi:10.1109/msp.2008.113 · Cited by 16
Learning understandable classifier models.
Chorowski, J. (2012) · ThinkIR: The University of Louisville's Institutional Repository (University of Louisville) · doi:10.18297/etd/248 · Cited by 4
Cited by
SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilities
Li, Z., Zou, D., Xu, S., Jin, H., Zhu, Y., & Chen, Z. (2022) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3051525 · Cited by 639
Software Vulnerability Detection Using Deep Neural Networks: A Survey
Lin, G., Wen, S., Han, Q.-L., Zhang, J., & Xiang, Y. (2020) · Proceedings of the IEEE · doi:10.1109/jproc.2020.2993293 · Cited by 457
A Survey of Android Malware Detection with Deep Neural Models
Qiu, J., Zhang, J., Luo, W., Pan, L., Nepal, S., & Xiang, Y. (2021) · ACM Computing Surveys · doi:10.1145/3417978 · Cited by 321
Adversarial Machine Learning Attacks and Defense Methods in the Cyber Security Domain
Rosenberg, I., Shabtai, A., Elovici, Y., & Rokach, L. (2022) · ACM Computing Surveys · doi:10.1145/3453158 · Cited by 295
A Taxonomy of Network Threats and the Effect of Current Datasets on Intrusion Detection Systems
Hindy, H., Brosset, D., Bayne, E., Seeam, A. K., Tachtatzis, C., Atkinson, R., & Bellekens, X. (2020) · IEEE Access · doi:10.1109/access.2020.3000179 · Cited by 273
Metadata
- Authors
- Ghaffarian, S. M., & Shahriari, H. R.
- Venue
- ACM Computing Surveys
- Published
- 2017-08-25
- Volume
- 50
- Issue
- 4
- Pages
- 1-36
- ISSN
- 0360-0300 (ISSN-L)
- 1557-7341
- OpenAlex
- W2748690817
- Cited by
- 353
- References
- 81
- FWCI
- 80.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.