The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Superion: Grammar-Aware Greybox Fuzzing
Open accessAbstract
In recent years, coverage-based greybox fuzzing has proven itself to be one of the most effective techniques for finding security bugs in practice. Particularly, American Fuzzy Lop (AFL for short) is deemed to be a great success in fuzzing relatively simple test inputs. Unfortunately, when it meets structured test inputs such as XML and JavaScript, those grammar-blind trimming and mutation strategies in AFL hinder the effectiveness and efficiency. To this end, we propose a grammar-aware coverage-based greybox fuzzing approach to fuzz programs that process structured inputs. Given the grammar (which is often publicly available) of test inputs, we introduce a grammar-aware trimming strategy to trim test inputs at the tree level using the abstract syntax trees (ASTs) of parsed test inputs. Further, we introduce two grammar-aware mutation strategies (i.e., enhanced dictionary-based mutation and tree-based mutation). Specifically, tree-based mutation works via replacing subtrees using the ASTs of parsed test inputs. Equipped with grammar-awareness, our approach can carry the fuzzing exploration into width and depth. We implemented our approach as an extension to AFL, named Superion; and evaluated the effectiveness of Superion using large- scale programs (i.e., an XML engine libplist and three JavaScript engines WebKit, Jerryscript and ChakraCore). Our results have demonstrated that Superion can improve the code coverage (i.e., 16.7% and 8.8% in line and function coverage) and bug-finding capability (i.e., 34 new bugs, among which we discovered 22 new vulnerabilities with 19 CVEs assigned and 3.2K USD bug bounty rewards received) over AFL and jsfunfuzz.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An empirical study of the reliability of UNIX utilities
Miller, B. P., Fredriksen, L., & So, B. (1990) · Communications of the ACM · doi:10.1145/96267.96279 · Cited by 1,281
Automated Whitebox Fuzz Testing.
Godefroid, P., Levin, M. Y., & Molnar, D. A. (2008) · Cited by 1,095
Driller: Augmenting Fuzzing Through Selective Symbolic Execution
Stephens, N., Grosen, J., Salls, C., Dutcher, A., Wang, R., Corbetta, J., Shoshitaishvili, Y., Kruegel, C., & Vigna, G. (2016) · Proceedings 2016 Network and Distributed System Security Symposium · doi:10.14722/ndss.2016.23368 · Cited by 887
Finding and understanding bugs in C compilers
Yang, X., Chen, Y., Eide, E., & Regehr, J. (2011) · Proceedings of the 32nd ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/1993498.1993532 · Cited by 825
ContractFuzzer: fuzzing smart contracts for vulnerability detection
Jiang, B., Liu, Y., & Chan, W. K. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238177 · Cited by 820
Self-citationBöhme, M., Pham, V.-T., Nguyen, M.-D., & Roychoudhury, A. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134020 · Cited by 747
Coverage-based Greybox Fuzzing as Markov Chain
Böhme, M., Pham, V.-T., & Roychoudhury, A. (2016) · Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2976749.2978428 · Cited by 649
Klees, G., Ruef, A., Cooper, B., Wei, S., & Hicks, M. (2018) · Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3243734.3243804 · Cited by 633
Finding and understanding bugs in C compilers
Yang, X., Chen, Y., Eide, E., & Regehr, J. (2011) · ACM SIGPLAN Notices · doi:10.1145/1993316.1993532 · Cited by 586
VUzzer: Application-aware Evolutionary Fuzzing
Rawat, S., Jain, V., Kumar, A., Cojocar, L., Giuffrida, C., & Bos, H. (2017) · Proceedings 2017 Network and Distributed System Security Symposium · doi:10.14722/ndss.2017.23404 · Cited by 584
SAGE: whitebox fuzzing for security testing
Godefroid, P., Levin, M. Y., & Molnar, D. (2012) · Communications of the ACM · doi:10.1145/2093548.2093564 · Cited by 567
Angora: Efficient Fuzzing by Principled Search
Chen, P., & Chen, H. (2018) · 2018 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2018.00046 · Cited by 552
Neural Network-based Graph Embedding for Cross-Platform Binary Code Similarity Detection
Xu, X., Liu, C., Feng, Q., Yin, H., Song, L., & Song, D. (2017) · Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3133956.3134018 · Cited by 530
FairFuzz: a targeted mutation strategy for increasing greybox fuzz testing coverage
Lemieux, C., & Sen, K. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238176 · Cited by 477
Grammar-based whitebox fuzzing
Godefroid, P., Kiezun, A., & Levin, M. Y. (2008) · Proceedings of the 29th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/1375581.1375607 · Cited by 462
Collaborative Security: A Survey and Taxonomy
Meng, G., Liu, Y., Zhang, J., Pokluda, A., & Boutaba, R. (2015) · ACM Computing Surveys · doi:10.1145/2785733 · Cited by 418
Self-citationCompiler validation via equivalence modulo inputs
Le, V., Afshari, M., & Su, Z. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594334 · Cited by 388 · cited 1×
“It is worth mentioning that application-specific fuzzers have been attracting great interests, e.g., compiler fuzzing [16, 18, 39, 40, 44, 60], kernel fuzzing [17, 31, 58], IoT (Internet of Things) fuzzing [14], OS fuzzing [49] and smart contract fuzzing [36].”
The Definitive ANTLR 4 Reference
Parr, T. (2013) · USF Scholarship Repository (University of San Francisco) · Cited by 381
TaintScope: A Checksum-Aware Directed Fuzzing Tool for Automatic Software Vulnerability Detection
Wang, T., Wei, T., Gu, G., & Zou, W. (2010) · 2010 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2010.37 · Cited by 380
CollAFL: Path Sensitive Fuzzing
Gan, S., Zhang, C., Qin, X., Tu, X., Li, K., Pei, Z., & Chen, Z. (2018) · 2018 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2018.00040 · Cited by 370
Taint-based directed whitebox fuzzing
Ganesh, V., Leek, T., & Rinard, M. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070546 · Cited by 348
Learn&Fuzz: Machine learning for input fuzzing
Godefroid, P., Peleg, H., & Singh, R. (2017) · 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115618 · Cited by 344
IoTFuzzer: Discovering Memory Corruptions in IoT Through App-based Fuzzing
Chen, J., Diao, W., Zhao, Q., Zuo, C., Lin, Z., Wang, X., Lau, W. C., Sun, M., Yang, R., & Zhang, K. (2018) · Network and Distributed System Security Symposium · doi:10.14722/ndss.2018.23159 · Cited by 337
Skyfire: Data-Driven Seed Generation for Fuzzing
Wang, J., Chen, B., Wei, L., & Liu, Y. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.23 · Cited by 315
Self-citationLAVA: Large-Scale Automated Vulnerability Addition
Dolan-Gavitt, B., Hulin, P., Kirda, E., Leek, T., Mambretti, A., Robertson, W., Ulrich, F., & Whelan, R. (2016) · 2016 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2016.15 · Cited by 300
Holler, C., Herzig, K., & Zeller, A. (2012) · Cited by 275
Steelix: program-state based binary fuzzing
Li, Y., Chen, B., Chandramohan, M., Lin, S.-W., Liu, Y., & Tiu, A. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106295 · Cited by 269
Self-citationHawkeye: Towards a Desired Directed Grey-box Fuzzer
Chen, H., Xue, Y., Li, Y., Chen, B., Xie, X., Wu, X., & Liu, Y. (2018) · Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3243734.3243849 · Cited by 263
Self-citationOptimizing Seed Selection for Fuzzing
Rebert, A., Cha, S. K., Avgerinos, T., Foote, J. M., Warren, D., Grieco, G., & Brumley, D. (2018) · KiltHub Repository · doi:10.1184/r1/6469118 · Cited by 231
Program-Adaptive Mutational Fuzzing
Cha, S. K., Woo, M., & Brumley, D. (2015) · 2015 IEEE Symposium on Security and Privacy · doi:10.1109/sp.2015.50 · Cited by 231
Compiler validation via equivalence modulo inputs
Le, V., Afshari, M., & Su, Z. (2014) · ACM SIGPLAN Notices · doi:10.1145/2666356.2594334 · Cited by 218
Dowsing for overflows: a guided fuzzer to find buffer boundary violations
Haller, I., Slowinska, A., Neugschwandtner, M., & Bos, H. (2013) · VU Research Portal · Cited by 194
Scheduling black-box mutational fuzzing
Woo, M., Cha, S. K., Gottlieb, S., & Brumley, D. (2013) · Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security - CCS '13 · doi:10.1145/2508859.2516736 · Cited by 182
Chen, Y., Groce, A., Zhang, C., Wong, W.-K., Fern, X. Z., Eide, E. N., & Regehr, J. D. (2013) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2491956.2462173 · Cited by 173
kAFL: Hardware-Assisted Feedback Fuzzing for {OS} Kernels
Schumilo, S., Aschermann, C., Gawlik, R., Schinzel, S., & Holz, T. (2017) · USENIX Security Symposium · Cited by 169
Finding compiler bugs via live code mutation
Sun, C., Le, V., & Su, Z. (2016) · Proceedings of the 2016 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications · doi:10.1145/2983990.2984038 · Cited by 168
Synthesizing program input grammars
Bastani, O., Sharma, R., Aiken, A., & Liang, P. (2017) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/3062341.3062349 · Cited by 166
Compiler fuzzing through deep learning
Cummins, C., Petoumenos, P., Murray, A. C., & Leather, H. (2018) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3213846.3213848 · Cited by 164
PerfFuzz: automatically generating pathological inputs
Lemieux, C., Padhye, R., Sen, K., & Song, D. (2018) · Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3213846.3213874 · Cited by 158
Lidbury, C., Lascu, A., Chong, N., & Donaldson, A. F. (2015) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2737924.2737986 · Cited by 157
Corina, J., Machiry, A., Salls, C., Shoshitaishvili, Y., Hao, S., Kruegel, C., & Vigna, G. (2017) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3133956.3134069 · Cited by 156
Statically-directed dynamic automated test generation
Babić, D., Martignoni, L., McCamant, S., & Song, D. X. (2011) · International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001423 · Cited by 154
Finding deep compiler bugs via guided stochastic program mutation
Le, V., Sun, C. P., & Su, Z. (2015) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2814270.2814319 · Cited by 152
Mining input grammars from dynamic taints
Höschele, M., & Zeller, A. (2016) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2970276.2970321 · Cited by 126
IFuzzer: An Evolutionary Interpreter Fuzzer Using Genetic Programming
Veggalam, S., Rawat, S., Haller, I., & Bos, H. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45744-4_29 · Cited by 125
Designing New Operating Primitives to Improve Fuzzing Performance
Xu, W. X., Kashyap, S., Min, C., & Kim, T. (2017) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3133956.3134046 · Cited by 123
Automated testing for SQL injection vulnerabilities: an input mutation approach
Appelt, D., Nguyen, C. D., Briand, L., & Alshahwan, N. (2014) · International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2610403 · Cited by 114
IMF: Inferred Model-based Fuzzer
Han, H.-S., & Kil, S. (2017) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3133956.3134103 · Cited by 114
Model-based whitebox fuzzing for program binaries
Pham, V.-T., Böhme, M., & Roychoudhury, A. (2016) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2970276.2970316 · Cited by 106
Badger: complexity analysis with fuzzing and symbolic execution
Noller, Y., Kersten, R., & Păsăreanu, C. S. (2018) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3213846.3213868 · Cited by 83
MoonShine: Optimizing OS Fuzzer Seed Selection with Trace Distillation.
Pailoor, S., Aday, A., & Jana, S. (2018) · USENIX Security Symposium · Cited by 77
The BORG: Nanoprobing Binaries for Buffer Overreads
Neugschwandtner, M., Comparetti, P. M., Haller, I., & Bos, H. (2015) · ACM Conference on Data and Application Security and Privacy (CODASPY) · doi:10.1145/2699026.2699098 · Cited by 62
Kargén, U., & Shahmehri, N. (2015) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2786805.2786844 · Cited by 60
Language fuzzing using constraint logic programming
Dewey, K. T., Roesch, J., & Hardekopf, B. (2014) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2642937.2642963 · Cited by 52
Probability-Based Parameter Selection for Black-Box Fuzz Testing
Householder, A. D., & Foote, J. M. (2012) · doi:10.21236/ada610472 · Cited by 36
Patra, J., & Pradel, M. (2016) · TUbilio (Technical University of Darmstadt) · Cited by 33
Probability-Based Parameter Selection for Black-Box Fuzz Testing
Householder, A. D., & Foote, J. M. (2012) · doi:10.1184/r1/6582245.v1 · Cited by 25
Chen, Y., Groce, A., Zhang, C., Wong, W.-K., Fern, X. Z., Eide, E. N., & Regehr, J. D. (2013) · ACM SIGPLAN Notices · doi:10.1145/2499370.2462173 · Cited by 24
Saying ‘Hi!’ is not enough: Mining inputs for effective test generation
Toffola, L. D., Staicu, C.-A., & Pradel, M. (2017) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115617 · Cited by 20
FOT: a versatile, configurable, extensible fuzzing framework
Chen, H., Li, Y., Chen, B., Xue, Y., & Liu, Y. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3264593 · Cited by 17
Self-citationGuo, R. (2017) · Communications of the ACM · doi:10.1145/3052937 · Cited by 11
Cited by
AFLNET: A Greybox Fuzzer for Network Protocols
Pham, V.-T., Bohme, M., & Roychoudhury, A. (2020) · 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST) · doi:10.1109/icst46399.2020.00062 · Cited by 342
Zhu, X., Wen, S., Camtepe, S., & Xiang, Y. (2022) · ACM Computing Surveys · doi:10.1145/3512345 · Cited by 334
Automated conformance testing for JavaScript engines via deep compiler fuzzing
Ye, G., Tang, Z., Tan, S. H., Huang, S., Fang, D., Sun, X., Bian, L., Wang, H., & Wang, Z. (2021) · Proceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation · doi:10.1145/3453483.3454054 · Cited by 77
Coverage guided, property based testing
Lampropoulos, L., Hicks, M., & Pierce, B. C. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360607 · Cited by 49
Qualitative Analysis for Validating IEC 62443-4-2 Requirements in DevSecOps
Göttel, C., Kabir-Querrec, M., Kozhaya, D., Sivanthi, T., & Vuković, O. (2023) · 2023 IEEE 28th International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa54631.2023.10275637 · Cited by 7
Metadata
- Authors
- Wang, J., Chen, B., Wei, L., & Liu, Y.
- Venue
- 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 724-735
- OpenAlex
- W2963350015
- Cited by
- 260
- References
- 61
- FWCI
- 21.44
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.