GRACE: Empowering LLM-based software vulnerability detection with graph structure and in-context learning
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Dong, Z., Hou, Y., Zhang, B., Min, Y., Zhang, J., Liu, P., et al. (2026) · Frontiers of Computer Science · doi:10.1007/s11704-026-60308-3 · Cited by 2,093
A Survey of Large Language Models
Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., Min, Y., Zhang, B., Zhang, J., Dong, Z., et al. (2023) · arXiv · doi:10.48550/arxiv.2303.18223 · Cited by 2,090
Wang, Y., Wang, W., Joty, S., & Hoi, S. C. H. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.685 · Cited by 1,495
Wang, Y., Wang, W., Joty, S., & Hoi, S. C. H. (2021) · arXiv · doi:10.48550/arxiv.2109.00859 · Cited by 1,495
Evaluating Large Language Models Trained on Code
Chen, M., Tworek, J., Jun, H., Yuan, Q., Pinto, H. P. D. O., Kaplan, J., Edwards, H., Burda, Y., Joseph, N., Brockman, G., et al. (2021) · arXiv · doi:10.48550/arxiv.2107.03374 · Cited by 1,436
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.759 · Cited by 755
Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?
Min, S., Lyu, X., Holtzman, A., Artetxe, M., Lewis, M., Hajishirzi, H., & Zettlemoyer, L. (2022) · arXiv · doi:10.48550/arxiv.2202.12837 · Cited by 752
A survey on tree edit distance and related problems
Bille, P. (2005) · Theoretical Computer Science · doi:10.1016/j.tcs.2004.12.030 · Cited by 751
Unified Pre-training for Program Understanding and Generation
Ahmad, W., Chakraborty, S., Ray, B., & Chang, K.-W. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.211 · Cited by 642
Automated Program Repair in the Era of Large Pre-trained Language Models
Xia, C. S., Wei, Y., & Zhang, L. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00129 · Cited by 433
Learning To Retrieve Prompts for In-Context Learning
Rubin, O., Herzig, J., & Berant, J. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.191 · Cited by 374
A Survey on In-context Learning
Dong, Q., Li, L., Dai, D., Zheng, C., Ma, J., Li, R., Xia, H., Xu, J., Wu, Z., Liu, T., et al. (2023) · arXiv · doi:10.48550/arxiv.2301.00234 · Cited by 248
Retrieval-Based Prompt Selection for Code-Related Few-Shot Learning
Nashid, N., Sintaha, M., & Mesbah, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00205 · Cited by 178
MetaICL: Learning to Learn In Context
Min, S., Lewis, M., Zettlemoyer, L., & Hajishirzi, H. (2022) · Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2022.naacl-main.201 · Cited by 169
Research works printed but not linked: 30
- Aslan, 2023, A comprehensive review of cyber security vulnerabilities, threats, attacks, and solutions, Electronics, 12, 1333, 10.3390/electronics12061333 · DOI · Paper page
- Belkina, 2019, Automated optimized parameters for T-distributed stochastic neighbor embedding improve visualization and analysis of large datasets, Nat. Commun., 10, 5415, 10.1038/s41467-019-13055-y · DOI · Paper page
- Cadwalladr, 2018, Revealed: 50 million facebook profiles harvested for Cambridge Analytica in major data breach, Guardian, 17, 22
- Cao, 2021, Bgnn4vd: Constructing bidirectional graph neural-network for vulnerability detection, Inf. Softw. Technol., 136, 10.1016/j.infsof.2021.106576 · DOI · Paper page
- Chakraborty, 2022, Deep learning based vulnerability detection: Are we there yet?, IEEE Trans. Softw. Eng., 48, 3280, 10.1109/TSE.2021.3087402 · DOI · Paper page
- Cheng, 2021, DeepWukong: Statically detecting software vulnerabilities using deep graph neural network, ACM Trans. Softw. Eng. Methodol., 30, 38:1, 10.1145/3436877 · DOI · Paper page
- Cheng, X., Zhang, G., Wang, H., Sui, Y., 2022. Path-sensitive code embedding via contrastive learning for software vulnerability detection. In: Proceedings of the 31st ACM SIGSOFT International Symposium on Software Testing and Analysis. pp. 519–531. · DOI
- Fu, M., Tantithamthavorn, C., 2022. Linevul: A transformer-based line-level vulnerability prediction. In: Proceedings of the 19th International Conference on Mining Software Repositories. pp. 608–620. · DOI · Paper page
- Fu, M., Tantithamthavorn, C., Le, T., Nguyen, V., Phung, D., 2022. VulRepair: a T5-based automated software vulnerability repair. In: Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. pp. 935–947. · DOI · Paper page
- Gu, Y., Han, X., Liu, Z., Huang, M., 2022. PPT: Pre-trained Prompt Tuning for Few-shot Learning. In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. pp. 8410–8423. · DOI · Paper page
- Guo, 2022, Detecting and augmenting missing key aspects in vulnerability descriptions, ACM Trans. Softw. Eng. Methodol. (TOSEM), 31, 1, 10.1145/3498537 · DOI
- Hin, D., Kan, A., Chen, H., Babar, M.A., 2022. LineVD: Statement-level vulnerability detection using graph neural networks. In: Proceedings of the 19th International Conference on Mining Software Repositories. pp. 596–607. · DOI · Paper page
- Hovsepyan, A., Scandariato, R., Joosen, W., Walden, J., 2012. Software vulnerability prediction using text analysis techniques. In: Proceedings of the 4th International Workshop on Security Measurements and Metrics. pp. 7–10. · doi:10.1145/2372225.2372230
- Kaur, 2020, A comparative study of static code analysis tools for vulnerability detection in c/c++ and java source code, Procedia Comput. Sci., 171, 2023, 10.1016/j.procs.2020.04.217 · DOI
- Kudjo, P.K., Chen, J., 2019. A cost-effective strategy for software vulnerability prediction based on bellwether analysis. In: Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis. pp. 424–427. · doi:10.1145/3293882.3338985
- Li, 2022, VulDeeLocator: A deep learning-based fine-grained vulnerability detector, IEEE Trans. Dependable Secur. Comput., 19, 2821, 10.1109/TDSC.2021.3076142 · DOI · Paper page
- Li, Z., Zou, D., Xu, S., Jin, H., Qi, H., Hu, J., 2016. Vulpecker: an automated vulnerability detection system based on code similarity analysis. In: Proceedings of the 32nd Annual Conference on Computer Security Applications. pp. 201–213. · DOI · Paper page
- Li, 2022, Sysevr: A framework for using deep learning to detect software vulnerabilities, IEEE Trans. Dependable Secur. Comput., 19, 2244, 10.1109/TDSC.2021.3051525 · DOI · Paper page
- Liu, Z., Xia, X., Hassan, A.E., Lo, D., Xing, Z., Wang, X., 2018. Neural-machine-translation-based commit message generation: how far are we?. In: Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering. pp. 373–384. · DOI · Paper page
- Ma, W., Zhao, M., Soremekun, E.O., Hu, Q., Zhang, J.M., Papadakis, M., Cordy, M., Xie, X., Traon, Y.L., GraphCode2Vec: Generic Code Embedding via Lexical and Program Dependence Analyses. In: 19th IEEE/ACM International Conference on Mining Software Repositories, MSR 2022, Pittsburgh, PA, USA, May 23-24, 2022. ACM, pp. 524–536. · DOI
- McGraw, 2004, Software security, IEEE Secur. Priv., 2, 80, 10.1109/MSECP.2004.1281254 · DOI · Paper page
- Nong, 2022, Open science in software engineering: A study on deep learning-based vulnerability detection, IEEE Trans. Softw. Eng., 49, 1983, 10.1109/TSE.2022.3207149 · DOI
- Shen, 2020, A survey of automatic software vulnerability detection, program repair, and defect prediction techniques, Secur. Commun. Netw., 1, 10.1155/2020/8858010 · DOI
- Sun, 2023, Assbert: Active and semi-supervised bert for smart contract vulnerability detection, J. Inf. Secur. Appl., 73
- Webb, 2010, Naïve Bayes., Ency. Mach. Learn., 15, 713
- Wu, Y., Zou, D., Dou, S., Yang, W., Xu, D., Jin, H., 2022. VulCNN: An image-inspired scalable vulnerability detection system. In: Proceedings of the 44th International Conference on Software Engineering. pp. 2365–2376. · DOI · Paper page
- Xue, Y., Ma, M., Lin, Y., Sui, Y., Ye, J., Peng, T., 2020. Cross-contract static analysis for detecting practical reentrancy vulnerabilities in smart contracts. In: Proceedings of the 35th IEEE/ACM International Conference on Automated Software Engineering. pp. 1029–1040. · DOI
- Zhang, 2023, Pre-trained model-based automated software vulnerability repair: How far are we?, IEEE Trans. Dependable Secure Comput.
- Zhao, L., Chen, S., Xu, Z., Liu, C., Zhang, L., Wu, J., Sun, J., Liu, Y., 2023a. Software Composition Analysis for Vulnerability Detection: An Empirical Study on Java Projects. In: Proceedings of the 2023 31th Acm Sigsoft International Symposium on Foundations of Software Engineering. · DOI
- Zhou, 2019, Devign: Effective vulnerability identification by learning comprehensive program semantics via graph neural networks, Adv. Neural Inf. Process. Syst., 32
Cited by
Large Language Models for Security Operations Centers: A Comprehensive Survey
Habibzadeh, A., Feyzi, F., & Atani, R. E. (2026) · Journal of Electrical and Computer Engineering · doi:10.1155/jece/3383674 · Cited by 13
Helping LLMs improve code generation using feedback from testing and static analysis
Dolcetti, G., Arceri, V., Iotti, E., Maffeis, S., Cortesi, A., & Zaffanella, E. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01009-5 · Cited by 8
A, N., & V, S. (2026) · Software Testing, Verification and Reliability · doi:10.1002/stvr.70021
Metadata
- Authors
- Lu, G., Ju, X., Chen, X., Pei, W., & Cai, Z.
- Venue
- Journal of Systems and Software
- Publisher
- Elsevier BV
- Published
- 2024-06
- Volume
- 212
- Pages
- 112031
- ISSN
- 0164-1212 (ISSN-L)
- OpenAlex
- W4393029443
- Cited by
- 179
- References
- 16
- FWCI
- 68.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.