A Systematic Literature Review on the Use of Deep Learning in Software Engineering Research
The DOI matches its Crossref record; 207 of the 207 references it cites were found in a registry or an index.
Abstract
An increasingly popular set of techniques adopted by software engineering (SE) researchers to automate development tasks are those rooted in the concept of Deep Learning (DL). The popularity of such techniques largely stems from their automated feature engineering capabilities, which aid in modeling software artifacts. However, due to the rapid pace at which DL techniques have been adopted, it is difficult to distill the current successes, failures, and opportunities of the current research landscape. In an effort to bring clarity to this cross-cutting area of work, from its modern inception to the present, this article presents a systematic literature review of research at the intersection of SE & DL. The review canvasses work appearing in the most prominent SE and DL conferences and journals and spans 128 papers across 23 unique SE tasks. We center our analysis around the components of learning , a set of principles that governs the application of machine learning techniques (ML) to a given problem domain, discussing several aspects of the surveyed work at a granular level. The end result of our analysis is a research roadmap that both delineates the foundations of DL techniques applied to SE research and highlights likely areas of fertile exploration for the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Deep learning models accelerate and enhance the accuracy of complex coding tasks [122, 214, 234].”
From A 2030 Roadmap for Software Engineering (2025) · cites this paper as [214]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Artificial intelligence can improve efficiency and reduce frustration by fixing errors, recommending best practices, and generating documentation [214].”
From A 2030 Roadmap for Software Engineering (2025) · cites this paper as [214]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · cited 1×
“rprisingly, there was very little work done between the years of 2009 and 2014. However, even after the popularization of DL techniques brought about by results achieved by approaches such as AlexNet [73], it took the SE community 3 years to begin exploring the use of DL techniques for SE tasks. This also coincides wi…”
MethodAdam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · cited 1×
“It can increase the rate at which the learning rate is optimized [88].”
BackgroundBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
(2014) · Cited by 33,419
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
(2014) · Cited by 15,747
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
(2016) · Cited by 11,679
(2010) · Cited by 8,261
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
Mining frequent patterns without candidate generation
Han, J., Pei, J., & Yin, Y. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335372 · Cited by 6,402
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
Proceedings of the 25th international conference on Machine learning
Cohen, W. W., McCallum, A., & Roweis, S. T. (2008) · Cited by 5,691
ADADELTA: An Adaptive Learning Rate Method
Zeiler, M. D. (2012) · arXiv · doi:10.48550/arxiv.1212.5701 · Cited by 5,322 · cited 1×
“Additionally, this optimization algorithm does not require a default learning rate, as it is defined by an exponentially decaying average of the calculated squared gradients up to a fixed size [184].”
Method(1996) · Cited by 4,738
Siamese Neural Networks for One-shot Image Recognition
Koch, G. E., Zemel, R. S., & Salakhutdinov, R. (2015) · Cited by 3,740
Explaining Explanations: An Overview of Interpretability of Machine Learning
Gilpin, L. H., Bau, D., Yuan, B. Z., Bajwa, A., Specter, M., & Kagal, L. (2018) · 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA) · doi:10.1109/dsaa.2018.00018 · Cited by 2,507 · cited 1×
“Thus, there exists an open research problem related to being able to explain how a given model was capable of predicting the target function, specifically as it relates to SE data [12, 59, 174, 178, 182].”
BackgroundEncyclopedia of Research Design
Salkind, N. (2010) · doi:10.4135/9781412961288 · Cited by 2,347 · cited 1×
“chanism for reducing sampling bias is to limit the amount of criteria and filtering the data is subjected to. DataSnooping occurs when data is reused for the purpose of training and testing the model [110]. Thismeansthatthedatathemodelwastrainedonisalsoincorporatedintothetestingandevaluation of the model’s success. Si…”
MethodEncyclopedia of research design
(2011) · Choice Reviews Online · doi:10.5860/choice.48-2447 · Cited by 1,910
Proceedings for the 5th International Conference on Learning Representations
Srivastava, A., & Sutton, C. A. (2017) · Cited by 1,837
Deep Learning for Anomaly Detection: A Survey
Chalapathy, R., & Chawla, S. (2019) · arXiv · doi:10.48550/arxiv.1901.03407 · Cited by 1,240
DeepTest: automated testing of deep-neural-network-driven autonomous cars
Tian, Y., Pei, K., Jana, S., & Ray, B. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180220 · Cited by 1,217
Beyond accuracy: behavioral testing of NLP models with CheckList
Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.442 · Cited by 890
Information Theory, Inference, and Learning Algorithms
(2004) · IEEE Transactions on Information Theory · doi:10.1109/tit.2004.834752 · Cited by 866 · cited 1×
“This operator is known asmutual information [116], which is measured in bits B.”
BackgroundLearning to Represent Programs with GraphsPreprint
Allamanis, M., Brockschmidt, M., & Khademi, M. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00740 · Cited by 845 · cited 4×
“MMR [24, 26, 34, 53, 63, 69, 75] BLEU Score [22, 27, 55, 61, 68, 127] METEOR Score [26, 126] Precision [8, 12, 30, 31, 36, 38, 53, 57, 60, 62, 65, 75, 77, 81, 84, 87, 97, 101, 109, 121, 122, 129, 134, 136, 138] Recall [8, 12, 16, 24, 30, 31, 36, 38, 57, 60, 62, 65, 77, 81, 84, 85, 88, 101, 109, 121, 129, 134, 138] F1-…”
BackgroundInfluentialA survey of deep learning-based network anomaly detection
Kwon, D., Kim, H., Kim, J., Suh, S. C., Kim, I., & Kim, K. J. (2019) · Cluster Computing · doi:10.1007/s10586-017-1117-8 · Cited by 778
Automatically learning semantic features for defect prediction
Wang, S., Liu, T., & Tan, L. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884804 · Cited by 689 · cited 2×
“07, 113, 117, 125, 141, 143] Image To Structured Representation [23, 37, 96] Software Security [21, 36, 49, 60, 61, 142] Program Repair [15, 61, 89, 123, 128] Software Reliability / Defect Prediction [58, 130, 134] Feature Location [34] Developer Forum Analysis [25, 84, 95, 138] Program Translation [28] Software Categ…”
MethodConvolutional Neural Networks over Tree Structures for Programming Language Processing
Mou, L., Li, G., Zhang, L., Wang, T., & Jin, Z. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10139 · Cited by 675 · cited 4×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodInfluentialA Novel Neural Source Code Representation Based on Abstract Syntax Tree
Zhang, J., Wang, X., Zhang, H., Sun, H., Wang, K., & Liu, X. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00086 · Cited by 655 · cited 5×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodInfluentialExplainable Deep Learning: A Field Guide for the UninitiatedPreprint
Ras, G., Xie, N., van Gerven, M. V., & Doran, D. (2020) · Journal of Artificial Intelligence Research · doi:10.48550/arxiv.2004.14545 · Cited by 622 · cited 1×
“Thus, there exists an open research problem related to being able to explain how a given model was capable of predicting the target function, specifically as it relates to SE data [12, 59, 174, 178, 182].”
BackgroundHu, X., Li, G., Xia, X., Lo, D., & Jin, Z. (2018) · Proceedings of the 26th Conference on Program Comprehension · doi:10.1145/3196321.3196334 · Cited by 621 · cited 2×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodZhang, M., Zhang, Y., Zhang, L., Liu, C., & Khurshid, S. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238187 · Cited by 611 · cited 3×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
BackgroundMethodDifferentiable Abstract Interpretation for Provably Robust Neural Networks
Mirman, M., Gehr, T., & Vechev, M. (2018) · International Conference on Machine Learning · Cited by 590
DeepGauge: multi-granularity testing criteria for deep learning systems
Ma, L., Juefei-Xu, F., Zhang, F., Sun, J., Xue, M., Li, B., Chen, C., Su, T., Li, L., Liu, Y., et al. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238202 · Cited by 588 · cited 1×
“nge of tasks in software engineering research including automatic program repair [122], code suggestion [53], defect prediction [129], malware detection [80], feature location [33], among many others [56, 87, 90, 93, 120, 126, 136, 138]. A recent report from the 2019 NSF Workshop on Deep Leaning & Software Enginee…”
BackgroundExplainability in Graph Neural Networks: A Taxonomic Survey
Yuan, H., Yu, H., Gui, S., & Ji, S. (2022) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2022.3204236 · Cited by 583 · cited 1×
“Thus, there exists an open research problem related to being able to explain how a given model was capable of predicting the target function, specifically as it relates to SE data [12, 59, 174, 178, 182].”
BackgroundNeural network studies. 1. Comparison of overfitting and overtraining
Tetko, I. V., Livingstone, D. J., & Luik, A. I. (1995) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00027a006 · Cited by 574 · cited 1×
“Overfitting is the process of a model learning to fit the training data extremely well, yet not being able to generalize to unseen data, and hence is a poor approximation of the actual target function to be learned [154].”
BackgroundDeep learning code fragments for code clone detection
White, M., Tufano, M., Vendome, C., & Poshyvanyk, D. (2016) · Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/2970276.2970326 · Cited by 558 · cited 3×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
BackgroundMethodSelf-citationCode completion with statistical language models
Raychev, V., Vechev, M., & Yahav, E. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594321 · Cited by 555 · cited 3×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodGu, X., Zhang, H., & Kim, S. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180167 · Cited by 547 · cited 2×
“at are likely to contain hidden patterns, DL techniques have ushered in advancements across a range of tasks in software engineering research including automatic program repair [122], code suggestion [53], defect prediction [129], malware detection [80], feature location [33], among many others [56, 87, 90, 93, 120, 1…”
BackgroundCodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
Lu, S., Guo, D., Ren, S., Huang, J., Svyatkovskiy, A., Blanco, A., Clement, C., Drain, D., Jiang, D., Tang, D., et al. (2021) · arXiv · doi:10.48550/arxiv.2102.04664 · Cited by 536 · cited 1×
“We have started to see recent progress in the derivation and sharing of large-scale datasets with efforts such as the CodeXGlue dataset from Microsoft [112].”
MethodSystematic literature review of machine learning based software development effort estimation models
Wen, J., Li, S., Lin, Z., Hu, Y., & Huang, C. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.002 · Cited by 526
Visualizing Deep Neural Network Decisions: Prediction Difference Analysis
Zintgraf, L. M., Cohen, T. S., Adel, T., & Welling, M. (2017) · arXiv · doi:10.48550/arxiv.1702.04595 · Cited by 487
Gu, X., Zhang, H., Zhang, D., & Kim, S. (2016) · Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2950290.2950334 · Cited by 485 · cited 3×
“e ###. Publication date: 2020. ###:14 Watson, Cooper, Palacio, Moran & Poshyvanyk Table 3. SE Task Taxonomy SE Task Papers Code Comprehension [8, 9, 14, 62, 76, 77, 79, 103] Souce Code Generation [22, 55, 63, 69, 135, 137] Source Code Retrieval & Traceability [24, 26, 38, 54, 57, 75] Source Code Summarization…”
BackgroundMethodGrounded theory in software engineering research: a critical review and guidelines
Stol, K.-J., Ralph, P., & Fitzgerald, B. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884833 · Cited by 470 · cited 1×
“several complementary methodologies. The first of these was an open coding methodology consistent with constructivist grounded theory [20]. Following the advice of recent work within the SE community [116], we stipulate our specific implementation of this type of grounded theory while discussing our deviations from th…”
MethodExplainable Deep Learning: A Field Guide for the Uninitiated
Ras, G., Xie, N., Van Gerven, M., & Doran, D. (2022) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.13200 · Cited by 446
DeepFix: Fixing Common C Language Errors by Deep Learning
Gupta, R., Pal, S., Kanade, A., & Shevade, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10742 · Cited by 426 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodReproducibility vs. Replicability: A Brief History of a Confused Terminology
Plesser, H. E. (2018) · Frontiers in Neuroinformatics · doi:10.3389/fninf.2017.00076 · Cited by 424
Improving automatic source code summarization via deep reinforcement learning
Wan, Y., Zhao, Z., Yang, M., Xu, G., Ying, H., Wu, J., & Yu, P. S. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238206 · Cited by 385 · cited 6×
“Distance Based CIDER [162, 195] Cross Entropy [75] Jaccard Distance [123] Model Perplexity [38, 86, 173] Edit Distance [57, 86] Exact Match [57] Likert Scale [82]”
BackgroundMethodInfluentialAn Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translation
Tufano, M., Watson, C., Bavota, G., Penta, M. D., White, M., & Poshyvanyk, D. (2019) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3340544 · Cited by 370
Self-citationSuggesting accurate method and class names
Allamanis, M., Barr, E. T., Bird, C., & Sutton, C. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786849 · Cited by 369 · cited 5×
“We found examples of this when generating accurate method and class names [9], learning proper API sequences [63], and source code summarization [11].”
MethodInfluentialDeep Learning for Just-in-Time Defect Prediction
Yang, X., Lo, D., Xia, X., Zhang, Y., & Sun, J. (2015) · 2015 IEEE International Conference on Software Quality, Reliability and Security · doi:10.1109/qrs.2015.14 · Cited by 352 · cited 1×
“analyzed the use of DL strategies within the scope of a specific SE task. For example, there have been a variety of SLRs performed for the use of DL applied to defect prediction or anomaly detection [6, 19, 74, 139]. These studies take a detailed look at the application of DL only within the scope of defect prediction…”
MethodNeural Programmer-Interpreters
Reed, S., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06279 · Cited by 347 · cited 2×
“es, pretraining the model, and pruning the search space. From our SLR, the most commonly used underfitting techniques applied were pruning the search space of the model [29, 125], curriculum training [29, 107, 141] and pretraining [114, 127]. We found that only 6/84 primary studies explicitly stated the implementation…”
MethodAdaptive Subgradient Methods for Online Learning and Stochastic Optimization
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2021068 · Cited by 346
Learn&Fuzz: Machine learning for input fuzzing
Godefroid, P., Peleg, H., & Singh, R. (2017) · 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115618 · Cited by 344
DeepBugs: a learning approach to name-based bug detection
Pradel, M., & Sen, K. (2018) · Proceedings of the ACM on Programming Languages · doi:10.1145/3276517 · Cited by 342
Towards a Big Data Curated Benchmark of Inter-project Code Clones
Svajlenko, J., Islam, J. F., Keivanloo, I., Roy, C. K., & Mia, M. M. (2014) · 2014 IEEE International Conference on Software Maintenance and Evolution · doi:10.1109/icsme.2014.77 · Cited by 339 · cited 1×
“Accuracy [89, 113] Solved Tasks [43, 114, 134] Other [21, 30–32, 35, 51, 53, 64, 68, 90, 96, 99, 108, 121, 127, 128, 137, 142] the SE task of clone detection, we found that the dataset BigCloneBench [118] was used frequently to test the quality of the DL frameworks. Also, for the task of defect prediction, we saw uses…”
MethodConcolic testing for deep neural networks
Sun, Y., Wu, M., Ruan, W., Huang, X., Kwiatkowska, M., & Kroening, D. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238172 · Cited by 332 · cited 1×
“These works focus on problems such as concolic testing for deep neural networks, addressing the lack of interoperability of DL systems by developing multi-granularity testing criteria, generating unique testing data through the use of generative adversarial networks, detecting bugs in the implementations of these DL m…”
BackgroundDeep Semantic Feature Learning for Software Defect Prediction
Wang, S., Liu, T., Nam, J., & Tan, L. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2877612 · Cited by 320
An empirical study on TensorFlow program bugs
Zhang, Y., Chen, Y., Cheung, S.-C., Xiong, Y., & Zhang, L. (2018) · Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3213846.3213866 · Cited by 304 · cited 1×
“These works focus on problems such as concolic testing for deep neural networks, addressing the lack of interoperability of DL systems by developing multi-granularity testing criteria, generating unique testing data through the use of generative adversarial networks, detecting bugs in the implementations of these DL m…”
BackgroundA Neural Model for Generating Natural Language Summaries of Program Subroutines
LeClair, A., Jiang, S., & McMillan, C. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00087 · Cited by 294 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodAre deep neural networks the best choice for modeling source code?
Hellendoorn, V. J., & Devanbu, P. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106290 · Cited by 292 · cited 3×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodTowards explainable deep neural networks (xDNN)
Angelov, P., & Soares, E. (2020) · Neural Networks · doi:10.1016/j.neunet.2020.07.010 · Cited by 292
Taxonomy of real faults in deep learning systems
Humbatova, N., Jahangirova, G., Bavota, G., Riccio, V., Stocco, A., & Tonella, P. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380395 · Cited by 291 · cited 1×
“However, they also learned that developers typically found that such errors require a relatively low amount of effort to fix [79].”
BackgroundConvolutional Neural Networks over Tree Structures for Programming Language ProcessingPreprint
Mou, L., Li, G., Zhang, L., et al. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1409.5718 · Cited by 285
The adverse effects of code duplication in machine learning models of code
Allamanis, M. (2019) · Proceedings of the 2019 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software · doi:10.1145/3359591.3359735 · Cited by 284
DLFuzz: differential fuzzing testing of deep learning systems
Guo, J., Jiang, Y., Zhao, Y., Chen, Q., & Sun, J. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3264835 · Cited by 281
Learning how to explain neural networks: PatternNet and PatternAttribution
Kindermans, P.-J., Schütt, K. T., Alber, M., Müller, K. R., Erhan, D., Kim, B., & Dähne, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.05598 · Cited by 264 · cited 1×
“These works focus on problems such as concolic testing for deep neural networks, addressing the lack of interoperability of DL systems by developing multi-granularity testing criteria, generating unique testing data through the use of generative adversarial networks, detecting bugs in the implementations of these DL m…”
BackgroundDeepSim: deep learning code functional similarity
Zhao, G., & Huang, J. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236068 · Cited by 261 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodAutomatically generating commit messages from diffs using neural machine translation
Jiang, S., Armaly, A., & McMillan, C. (2017) · 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115626 · Cited by 255
Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps
Moran, K., Bernal-Cardenas, C., Curcio, M., Bonett, R., & Poshyvanyk, D. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2844788 · Cited by 239
Self-citationSemantically Enhanced Software Traceability Using Deep Learning Techniques
Guo, J., Cheng, J., & Cleland-Huang, J. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.9 · Cited by 232 · cited 1×
“nge of tasks in software engineering research including automatic program repair [122], code suggestion [53], defect prediction [129], malware detection [80], feature location [33], among many others [56, 87, 90, 93, 120, 126, 136, 138]. A recent report from the 2019 NSF Workshop on Deep Leaning & Software Enginee…”
BackgroundDeepJIT: An End-to-End Deep Learning Framework for Just-in-Time Defect Prediction
Hoang, T., Khanh Dam, H., Kamei, Y., Lo, D., & Ubayashi, N. (2019) · 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00016 · Cited by 223 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodOreo: detection of clones in the twilight zone
Saini, V., Farmahinifarahani, F., Lu, Y., Baldi, P., & Lopes, C. V. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3236026 · Cited by 219 · cited 3×
“, 126] Big-Fixing Process [16, 38, 75, 78, 98] Code Smells [87] Mobile Testing [91] Traditional Software Testing [35, 51, 114] Non Code Related Software Artifacts [30–32, 68, 92, 112] Clone Detection [49, 81, 85, 109, 121, 136] Software Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64…”
BackgroundMethodLearning to mine aligned code and natural language pairs from stack overflow
Yin, P., Deng, B., Chen, E., Vasilescu, B., & Neubig, G. (2018) · Proceedings of the 15th International Conference on Mining Software Repositories · doi:10.1145/3196398.3196408 · Cited by 218 · cited 5×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodInfluentialCCLearner: A Deep Learning-Based Clone Detection Approach
Li, L., Feng, H., Zhuang, W., Meng, N., & Ryder, B. (2017) · 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme.2017.46 · Cited by 214
DeepCoder: Learning to Write Programs
Balog, M., Gaunt, A. L., Brockschmidt, M., Nowozin, S., & Tarlow, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01989 · Cited by 212 · cited 2×
“11, 12, 23, 28, 29, 32, 44, 49, 61, 62, 64, 65, 77, 83, 84, 101, 109, 113, 125, 128, 143] CIDER [127, 143] ROC [49, 109, 134, 142] Root Mean Squared Error [58, 112] Model Perplexity [135, 137] Timing [13, 43, 44, 95, 136] AUC [30, 31, 36, 49, 109, 134] Macro-averaged Mean Absolute Error (MMAE) [30, 31] Mean Absolute E…”
MethodA Deep Learning Model for Estimating Story Points
Choetkiertikul, M., Dam, H. K., Tran, T., Pham, T., Ghose, A., & Menzies, T. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2792473 · Cited by 211 · cited 2×
“Accuracy [16, 17, 20, 22, 28, 30, 40–42, 44, 58, 71, 74, 83, 96, 97, 99, 105, 122, 123, 130, 137, 149, 176, 186] [10, 13, 19, 26, 31, 34, 37, 48, 56, 68, 69, 72, 73, 75, 78, 94, 102, 103, 111, 121, 124, 126, 133, 140, 145, 151, 157, 163, 171, 180, 195]”
MODE: automated neural network model debugging via state differential analysis and input selection
Ma, S., Liu, Y., Lee, W.-C., Zhang, X., & Grama, A. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236082 · Cited by 211 · cited 1×
“These works focus on problems such as concolic testing for deep neural networks, addressing the lack of interoperability of DL systems by developing multi-granularity testing criteria, generating unique testing data through the use of generative adversarial networks, detecting bugs in the implementations of these DL m…”
BackgroundOn Learning Meaningful Code Changes Via Neural Machine Translation
Tufano, M., Pantiuchina, J., Watson, C., Bavota, G., & Poshyvanyk, D. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00021 · Cited by 207 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodSelf-citationVulSeeker: a semantic learning based vulnerability seeker for cross-platform binary
Gao, J., Yang, X., Fu, Y., Jiang, Y., & Sun, J. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3240480 · Cited by 206 · cited 2×
“, 126] Big-Fixing Process [16, 38, 75, 78, 98] Code Smells [87] Mobile Testing [91] Traditional Software Testing [35, 51, 114] Non Code Related Software Artifacts [30–32, 68, 92, 112] Clone Detection [49, 81, 85, 109, 121, 136] Software Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64…”
BackgroundToward deep learning software repositories
White, M., Vendome, C., & Poshyvanyk, D. (2015) · Cited by 192
Self-citationαDiff: cross-version binary code similarity detection with DNN
Liu, B., Huo, W., Zhang, C., Li, W., Li, F., Piao, A., & Zou, W. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3238199 · Cited by 192 · cited 2×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodChen, C., Su, T., Meng, G., Xing, Z., & Liu, Y. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180240 · Cited by 188
Sentiment analysis for software engineering: how far can we go?
Lin, B., Zampetti, F., Bavota, G., Di Penta, M., Lanza, M., & Oliveto, R. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180195 · Cited by 187
Learning to Predict Severity of Software Vulnerability Using Only Vulnerability Description
Han, Z., Li, X., Xing, Z., Liu, H., & Feng, Z. (2017) · 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme.2017.52 · Cited by 185 · cited 2×
“oftware Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To Structured Representation [23, 37, 96] Software Security [21, 36, 49, 60, 61, 142] Program Repair [15, 61, 89, 123, 128] Software Reliability / Defect Prediction [58, 130, 134]…”
BackgroundMethodAutomatic Feature Learning for Predicting Vulnerable Software Components
Dam, H. K., Tran, T., Pham, T., Ng, S. W., Grundy, J., & Ghose, A. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2881961 · Cited by 184
Big code != big vocabulary: open-vocabulary models for source code
Karampatsis, R.-M., Babii, H., Robbes, R., Sutton, C., & Janes, A. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380342 · Cited by 182
Hellendoorn, V. J., Bird, C., Barr, E. T., & Allamanis, M. (2018) · Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3236024.3236051 · Cited by 181 · cited 2×
“orization. However, there are , Vol. ##, No. #, Article ###. Publication date: 2020. ###:14 Watson, Cooper, Palacio, Moran & Poshyvanyk Table 3. SE Task Taxonomy SE Task Papers Code Comprehension [8, 9, 14, 62, 76, 77, 79, 103] Souce Code Generation [22, 55, 63, 69, 135, 137] Source Code Retrieval & Traceabili…”
BackgroundCombining Deep Learning with Information Retrieval to Localize Buggy Files for Bug Reports (N)
Lam, A. N., Nguyen, A. T., Nguyen, H. A., & Nguyen, T. N. (2015) · 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.73 · Cited by 179 · cited 3×
“by White et al. [135]. Our findings illustrate that source code is used as an unlabeled, yet useful set of data across several SE tasks including: the localization of buggy files through bug reports [75], specification mining [77], mining fix patterns for bug violations [89], identification of source code clones [121]…”
BackgroundRasmussen, C. E., & Ghahramani, Z. (2000) · neural information processing systems · Cited by 172
Lessons Learned from Using a Deep Tree-Based Model for Software Defect Prediction in Practice
Dam, H. K., Pham, T., Ng, S. W., Tran, T., Grundy, J., Ghose, A., Kim, T., & Kim, C.-J. (2019) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00017 · Cited by 172 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodXu, B., Ye, D., Xing, Z., Xia, X., Chen, G.-B., & Li, S. (2016) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2970276.2970357 · Cited by 171 · cited 5×
“Recall [9, 13, 32, 33, 39, 41, 65, 71, 73, 78, 94, 99, 103, 104, 106, 140, 165, 170, 176] [18, 27, 64, 64, 101, 108, 117, 119, 126, 129, 133, 155, 158, 166, 175, 179–181, 185, 190, 191]”
BackgroundMethodInfluentialDeepPerf: Performance Prediction for Configurable Software with Deep Sparse Neural Network
Ha, H., & Zhang, H. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00113 · Cited by 168 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodSorting and Transforming Program Repair Ingredients via Deep Learning Code Similarities
White, M., Tufano, M., Martinez, M., Monperrus, M., & Poshyvanyk, D. (2019) · 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8668043 · Cited by 163 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
BackgroundMethodSelf-citationMining Fix Patterns for FindBugs Violations
Liu, K., Kim, D., Bissyandé, T. F., Yoo, S., & Traon, Y. L. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2884955 · Cited by 163 · cited 3×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
BackgroundMethodLi, Y., Wang, S., Nguyen, T. N., & Van Nguyen, S. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360588 · Cited by 162
Deep learning similarities from different representations of source code
Tufano, M., Watson, C., Bavota, G., Di Penta, M., White, M., & Poshyvanyk, D. (2018) · Proceedings of the 15th International Conference on Mining Software Repositories · doi:10.1145/3196398.3196431 · Cited by 158 · cited 5×
“Ranking F-Rank [62] Top K-Based [80, 107, 120, 136, 145] Spearmans Rank [158] MRR [27, 29, 35, 62, 74, 80, 84, 92] Kruskal’s γ [193]”
BackgroundMethodInfluentialSelf-citationTree-to-tree neural networks for program translation
Chen, X., Liu, C., & Song, D. (2018) · arXiv · doi:10.48550/arxiv.1802.03691 · Cited by 157 · cited 2×
“109, 121, 129, 134, 138] F1-Measure [8, 10, 30, 31, 36, 60, 65, 76, 77, 88, 121, 130, 134, 138, 142] Accuracy [14, 15, 17, 18, 25, 37–40, 50, 60, 63, 78, 79, 81, 86, 98, 99, 103, 107, 117, 138, 141] [9, 11, 12, 23, 28, 29, 32, 44, 49, 61, 62, 64, 65, 77, 83, 84, 101, 109, 113, 125, 128, 143] CIDER [127, 143] ROC [49,…”
MethodEasy over hard: a case study on deep learning
Fu, W., & Menzies, T. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106256 · Cited by 155 · cited 3×
“A valid question for many proposed DL techniques applied to SE tasks is whether the complexity of the model is worth the gains in effectiveness or automation for a given task, as recent research has illustrated [55].”
BackgroundMethodInfluentialEncyclopedia of research design
Salkind, N. J. (n.d.) · Cited by 151
Learning from Data: A Short Course
Abu‐Mostafa, Y. S., Magdon‐Ismail, M., & Lin, H.-T. (2012) · Cited by 149
Compiler fuzzing through deep learning
Cummins, C., Petoumenos, P., Murray, A., & Leather, H. (2018) · Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3213846.3213848 · Cited by 147 · cited 2×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
BackgroundMethodLearning to Spot and Refactor Inconsistent Method Names
Liu, K., Kim, D., Bissyandé, T. F., Kim, T.-Y., Kim, K., Koyuncu, A., Kim, S., & Traon, Y. L. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00019 · Cited by 144 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodTufano, M., Watson, C., Bavota, G., Di Penta, M., White, M., & Poshyvanyk, D. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3240732 · Cited by 133 · cited 2×
“Classification Measures Precision [9, 13, 32, 33, 41, 62, 65, 71, 73, 92, 94, 99, 106, 140, 159, 165, 172, 176] [18, 39, 49, 64, 78, 80, 101, 103, 108, 117, 119, 120, 126, 129, 155, 158, 166, 170, 175, 179, 181, 185, 190, 191]”
BackgroundSelf-citationDeep learning based feature envy detection
Liu, H., Xu, Z., & Zou, Y. (2018) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3238147.3238166 · Cited by 133 · cited 5×
“Recall [9, 13, 32, 33, 39, 41, 65, 71, 73, 78, 94, 99, 103, 104, 106, 140, 165, 170, 176] [18, 27, 64, 64, 101, 108, 117, 119, 126, 129, 133, 155, 158, 166, 175, 179–181, 185, 190, 191]”
BackgroundMethodInfluentialTowards Accurate Duplicate Bug Retrieval Using Deep Learning Techniques
Deshmukh, J., Annervaz, K. M., Podder, S., Sengupta, S., & Dubash, N. (2017) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2017.69 · Cited by 131 · cited 2×
“& Poshyvanyk Table 3. SE Task Taxonomy SE Task Papers Code Comprehension [8, 9, 14, 62, 76, 77, 79, 103] Souce Code Generation [22, 55, 63, 69, 135, 137] Source Code Retrieval & Traceability [24, 26, 38, 54, 57, 75] Source Code Summarization [10, 26, 126] Big-Fixing Process [16, 38, 75, 78, 98] Code Smells [87…”
BackgroundNeural Detection of Semantic Code Clones Via Tree-Based Convolution
Yu, H., Lam, W., Chen, L., Li, G., Xie, T., & Wang, Q. (2019) · 2019 IEEE/ACM 27th International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2019.00021 · Cited by 128 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodCNN-FL: An Effective Approach for Localizing Faults using Convolutional Neural Networks
Zhang, Z., Lei, Y., Mao, X., & Li, P. (2019) · 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8668002 · Cited by 126 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodA Convolutional Attention Network for Extreme Summarization of Source Code
Allamanis, M., Peng, H. M., & Sutton, C. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03001 · Cited by 126 · cited 3×
“53, 57, 60, 62, 65, 75, 77, 81, 84, 87, 97, 101, 109, 121, 122, 129, 134, 136, 138] Recall [8, 12, 16, 24, 30, 31, 36, 38, 57, 60, 62, 65, 77, 81, 84, 85, 88, 101, 109, 121, 129, 134, 138] F1-Measure [8, 10, 30, 31, 36, 60, 65, 76, 77, 88, 121, 130, 134, 138, 142] Accuracy [14, 15, 17, 18, 25, 37–40, 50, 60, 63, 78, 7…”
BackgroundMethodMaking Neural Programming Architectures Generalize via RecursionPreprint
Cai, J., Shin, R., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.06611 · Cited by 124 · cited 1×
“ng [91] Traditional Software Testing [35, 51, 114] Non Code Related Software Artifacts [30–32, 68, 92, 112] Clone Detection [49, 81, 85, 109, 121, 136] Software Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To Structured Representati…”
MethodNL2Type: Inferring JavaScript Function Types from Natural Language Information
Malik, R. S., Patra, J., & Pradel, M. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2019.00045 · Cited by 123 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodLearning Program Embeddings to Propagate Feedback on Student Code
Piech, C., Huang, J., Nguyen, A., Phulsuksombati, M., Sahami, M., & Guibas, L. J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.05969 · Cited by 122 · cited 1×
“orization. However, there are , Vol. ##, No. #, Article ###. Publication date: 2020. ###:14 Watson, Cooper, Palacio, Moran & Poshyvanyk Table 3. SE Task Taxonomy SE Task Papers Code Comprehension [8, 9, 14, 62, 76, 77, 79, 103] Souce Code Generation [22, 55, 63, 69, 135, 137] Source Code Retrieval & Traceabili…”
BackgroundApplying deep learning based automatic bug triager to industrial projects
Lee, S.-R., Heo, M.-J., Lee, C.-G., Kim, M., & Jeong, G. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3117776 · Cited by 119 · cited 1×
“14, 62, 76, 77, 79, 103] Souce Code Generation [22, 55, 63, 69, 135, 137] Source Code Retrieval & Traceability [24, 26, 38, 54, 57, 75] Source Code Summarization [10, 26, 126] Big-Fixing Process [16, 38, 75, 78, 98] Code Smells [87] Mobile Testing [91] Traditional Software Testing [35, 51, 114] Non Code Related So…”
BackgroundLearning to Infer Graphics Programs from Hand-Drawn Images
Ellis, K., Ritchie, D., Solar-Lezama, A., & Tenenbaum, J. B. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 111
Neuro-symbolic program corrector for introductory programming assignments
Bhatia, S., Kohli, P., & Singh, R. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3180155.3180219 · Cited by 107 · cited 1×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodA Grammar-Based Structural CNN Decoder for Code Generation
Sun, Z., Zhu, Q., Mou, L., Xiong, Y., Li, G., & Zhang, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017055 · Cited by 107
Enhancing Explainability of Neural Networks Through Architecture Constraints
Yang, Z., Zhang, A., & Sudjianto, A. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3007259 · Cited by 106 · cited 1×
“Thus, there exists an open research problem related to being able to explain how a given model was capable of predicting the target function, specifically as it relates to SE data [12, 59, 174, 178, 182].”
BackgroundTypeWriter: neural type prediction with search-based validation
Pradel, M., Gousios, G., Liu, J., & Chandra, S. (2020) · Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3368089.3409715 · Cited by 102 · cited 1×
“Only one paper, which was published in arXiv in 2019, was manually added, as we believe it is relevant to the DL4SE field and has been cited by a number of impactful, peer-reviewed publications in well-regarded SE venues [6, 85, 132, 153].”
BackgroundA neural framework for retrieval and summarization of source code
Chen, Q., & Zhou, M. (2018) · Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering · doi:10.1145/3238147.3240471 · Cited by 98 · cited 5×
“The first SE tasks to use a DL technique were those of Source Code Generation, Code Comprehension, Source Code Retrieval & Traceability, Bug-Fixing Processes, and Feature Location.”
MethodInfluentialDeepFuzz: Automatic Generation of Syntax Valid C Programs for Fuzz Testing
Liu, X., Li, X., Prajapati, R., & Wu, D. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33011044 · Cited by 95 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
BackgroundMethodLearning-Based Recursive Aggregation of Abstract Syntax Trees for Code Clone Detection
Buch, L., & Andrzejak, A. (2019) · 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8668039 · Cited by 93 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodNeuro-Symbolic Program Synthesis
Parisotto, E., Mohamed, A., Singh, R. K., Li, L. C., Zhou, D., & Kohli, P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01855 · Cited by 92 · cited 1×
“Coverage & Proportions Rate or Percentages [25, 36, 49, 62, 67, 110, 164, 180, 192] Coverage-Based [60, 109, 110, 128, 166, 187] Solved Tasks [15, 47, 67, 146, 170] Cost-Effectiveness [111, 171] Total Energy or Memory Consumption [139]”
BackgroundRobustFill: Neural Program Learning under Noisy I/O
Devlin, J., Uesato, J., Bhupatiraju, S., Singh, R. K., Mohamed, A., & Kohli, P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.07469 · Cited by 91
Deep Learning in Automotive Software
Falcini, F., Lami, G., & Costanza, A. M. (2017) · IEEE Software · doi:10.1109/ms.2017.79 · Cited by 91
Explainability in Graph Neural Networks: A Taxonomic SurveyPreprint
Yuan, H., Yu, H., Gui, S., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.15445 · Cited by 89 · cited 1×
“Thus, there exists an open research problem related to being able to explain how a given model was capable of predicting the target function, specifically as it relates to SE data [12, 59, 174, 178, 182].”
BackgroundMemory Augmented Policy Optimization for Program Synthesis and Semantic Parsing
Chen, L., Norouzi, M. H., Berant, J., Le, Q. V., & Lao, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.02322 · Cited by 88 · cited 2×
“109, 121, 129, 134, 138] F1-Measure [8, 10, 30, 31, 36, 60, 65, 76, 77, 88, 121, 130, 134, 138, 142] Accuracy [14, 15, 17, 18, 25, 37–40, 50, 60, 63, 78, 79, 81, 86, 98, 99, 103, 107, 117, 138, 141] [9, 11, 12, 23, 28, 29, 32, 44, 49, 61, 62, 64, 65, 77, 83, 84, 101, 109, 113, 125, 128, 143] CIDER [127, 143] ROC [49,…”
MethodCross-Language Clone Detection by Learning Over Abstract Syntax Trees
Pérez, D., & Chiba, S. (2019) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00078 · Cited by 87 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodGraph Embedding Based Familial Analysis of Android Malware using Unsupervised Learning
Fan, M. Y., Luo, X., Liu, J., Wang, M., Nong, C., Zheng, Q., & Liu, T. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00085 · Cited by 86 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodChen, C., Xing, Z., Liu, Y., & Xiong, K. O. L. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2896123 · Cited by 82 · cited 4×
“MMR [24, 26, 34, 53, 63, 69, 75] BLEU Score [22, 27, 55, 61, 68, 127] METEOR Score [26, 126] Precision [8, 12, 30, 31, 36, 38, 53, 57, 60, 62, 65, 75, 77, 81, 84, 87, 97, 101, 109, 121, 122, 129, 134, 136, 138] Recall [8, 12, 16, 24, 30, 31, 36, 38, 57, 60, 62, 65, 77, 81, 84, 85, 88, 101, 109, 121, 129, 134, 138] F1-…”
BackgroundInfluentialLearning to Repair Software Vulnerabilities with Generative Adversarial NetworksPreprint
Harer, J., Özdemir, O., Lazovich, T., Reale, C., Russell, R. L., Kim, L. Y., & Chin, P. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.07475 · Cited by 81 · cited 4×
“oftware Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To Structured Representation [23, 37, 96] Software Security [21, 36, 49, 60, 61, 142] Program Repair [15, 61, 89, 123, 128] Software Reliability / Defect Prediction [58, 130, 134]…”
MethodInfluentialDifferentiable Programs with Neural LibrariesPreprint
Gaunt, A. L., Brockschmidt, M., Kushman, N., & Tarlow, D. (2016) · International Conference on Machine Learning · doi:10.48550/arxiv.1611.02109 · Cited by 80 · cited 2×
“ng [91] Traditional Software Testing [35, 51, 114] Non Code Related Software Artifacts [30–32, 68, 92, 112] Clone Detection [49, 81, 85, 109, 121, 136] Software Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To Structured Representati…”
MethodNeural Program Synthesis from Diverse Demonstration Videos
Sun, S., Noh, H., Somasundaram, S., & Lim, J. J. (2018) · International Conference on Machine Learning · Cited by 78
Huang, Q., Xia, X., Lo, D., & Murphy, G. C. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2876340 · Cited by 78 · cited 5×
“Recall [9, 13, 32, 33, 39, 41, 65, 71, 73, 78, 94, 99, 103, 104, 106, 140, 165, 170, 176] [18, 27, 64, 64, 101, 108, 117, 119, 126, 129, 133, 155, 158, 166, 175, 179–181, 185, 190, 191]”
MethodInfluentialDeep Transfer Bug Localization
Huo, X., Thung, F., Li, M., Lo, D., & Shi, S.-T. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2920771 · Cited by 78
Predicting Delivery Capability in Iterative Software Development
Choetkiertikul, M., Dam, H. K., Tran, T., Ghose, A., & Grundy, J. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2693989 · Cited by 76 · cited 4×
“ROC/AUC [21, 32, 33, 38, 39, 56, 76, 111, 140, 144, 170, 170, 179, 193] F-Score [9, 11, 18, 32, 33, 38, 39, 49, 64, 71, 78, 93, 94, 101, 106, 108, 117, 129, 144, 155, 158, 165, 166, 170, 175, 176, 181, 185, 190, 191, 193] Matthews Correlation [33, 155] Scott-Knott Test [111] Exam-Metric [189] Clustering-Based [52]”
InfluentialAutoPandas: neural-backed generators for program synthesis
Bavishi, R., Lemieux, C., Fox, R., Sen, K., & Stoica, I. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3360594 · Cited by 73
Using recurrent neural networks for decompilation
Katz, D. S., Ruchti, J., & Schulte, E. (2018) · 2018 IEEE 25th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330222 · Cited by 71 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodAutomatic Text Input Generation for Mobile Testing
Liu, P., Zhang, X., Pistoia, M., Zheng, Y., Marques, M., & Zeng, L. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.65 · Cited by 70 · cited 1×
“nge of tasks in software engineering research including automatic program repair [122], code suggestion [53], defect prediction [129], malware detection [80], feature location [33], among many others [56, 87, 90, 93, 120, 126, 136, 138]. A recent report from the 2019 NSF Workshop on Deep Leaning & Software Enginee…”
BackgroundNeural-Guided Deductive Search for Real-Time Program Synthesis from Examples
Kalyan, A., Mohta, A., Polozov, O., Batra, D., Jain, P., & Gulwani, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.01186 · Cited by 69 · cited 1×
“From our SLR, the most commonly used underfitting techniques applied were pruning the search space of the model [30, 83], curriculum training [30, 137, 186], and pretraining [146, 162].”
MethodImage-to-Markup Generation with Coarse-to-Fine Attention
Deng, Y., Kanervisto, A., Ling, J., & Rush, A. M. (2017) · International Conference on Machine Learning · Cited by 69
Yin, P., Neubig, G., Allamanis, M., Brockschmidt, M., & Gaunt, A. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.13337 · Cited by 67 · cited 5×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
BackgroundMethodInfluentialLatent Attention For If-Then Program SynthesisPreprint
Chen, X., Liu, C., Shin, E. C. R., Song, D., & Chen, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.01867 · Cited by 66 · cited 1×
“ng [91] Traditional Software Testing [35, 51, 114] Non Code Related Software Artifacts [30–32, 68, 92, 112] Clone Detection [49, 81, 85, 109, 121, 136] Software Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To Structured Representati…”
MethodSeqFuzzer: An Industrial Protocol Fuzzing Framework from a Deep Learning Perspective
Zhao, H., Li, Z., Wei, H., Shi, J., & Huang, Y. (2019) · 2019 12th IEEE Conference on Software Testing, Validation and Verification (ICST) · doi:10.1109/icst.2019.00016 · Cited by 65 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
BackgroundMethodA deep learning approach to identifying source code in images and video
Ott, J., Atchison, A., Harnack, P., Bergh, A., & Linstead, E. J. (2018) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3196398.3196402 · Cited by 63 · cited 3×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodImproving Neural Program Synthesis with Inferred Execution Traces
Shin, E. C. R., Polosukhin, I., & Song, D. X. (2018) · neural information processing systems · Cited by 62
A Literature Review of Artificial Intelligence
Wafa, A. W. A., & Muzammil Hussain, M. H. (2021) · UMT Artificial Intelligence Review · doi:10.32350/air.11.01 · Cited by 61
Learning Loop Invariants for Program Verification
Si, X., Dai, H., Raghothaman, M., Naik, M., & Song, L. (2018) · neural information processing systems · Cited by 60
Predicting the delay of issues with due dates in software projects
Choetkiertikul, M., Dam, H. K., Tran, T., & Ghose, A. (2017) · Empirical Software Engineering · doi:10.1007/s10664-016-9496-7 · Cited by 58
ActionNet: Vision-Based Workflow Action Recognition From Programming Screencasts
Zhao, D., Xing, Z., Chen, C., Xia, X., & Li, G. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00049 · Cited by 58 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodExploring the use of deep learning for feature location
Corley, C. S., Damevski, K., & Kraft, N. A. (2015) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2015.7332513 · Cited by 57 · cited 2×
“ge To Structured Representation [23, 37, 96] Software Security [21, 36, 49, 60, 61, 142] Program Repair [15, 61, 89, 123, 128] Software Reliability / Defect Prediction [58, 130, 134] Feature Location [34] Developer Forum Analysis [25, 84, 95, 138] Program Translation [28] Software Categorization [11] Code Location Wit…”
BackgroundMethodFine-grained Android Malware Detection based on Deep Learning
Li, D., Wang, Z., & Xue, Y. (2018) · IEEE Conference on Communications and Network Security · doi:10.1109/cns.2018.8433204 · Cited by 57 · cited 1×
“niques have ushered in advancements across a range of tasks in software engineering research including automatic program repair [122], code suggestion [53], defect prediction [129], malware detection [80], feature location [33], among many others [56, 87, 90, 93, 120, 126, 136, 138]. A recent report from the 2019 NSF…”
BackgroundHow Well Do Change Sequences Predict Defects? Sequence Learning from Software Changes
Wen, M., Wu, R., & Cheung, S.-C. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2876256 · Cited by 57 · cited 5×
“Recall [9, 13, 32, 33, 39, 41, 65, 71, 73, 78, 94, 99, 103, 104, 106, 140, 165, 170, 176] [18, 27, 64, 64, 101, 108, 117, 119, 126, 129, 133, 155, 158, 166, 175, 179–181, 185, 190, 191]”
BackgroundMethodInfluentialLe, T.-D. B., & Lo, D. (2018) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3213846.3213876 · Cited by 54 · cited 3×
“orization. However, there are , Vol. ##, No. #, Article ###. Publication date: 2020. ###:14 Watson, Cooper, Palacio, Moran & Poshyvanyk Table 3. SE Task Taxonomy SE Task Papers Code Comprehension [8, 9, 14, 62, 76, 77, 79, 103] Souce Code Generation [22, 55, 63, 69, 135, 137] Source Code Retrieval & Traceabili…”
BackgroundAutomatic Code Review by Learning the Revision of Source Code
Shi, S., Li, M., Lo, D., Thung, F., & Huo, X. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014910 · Cited by 54
Deep Reinforcement Learning for Syntactic Error Repair in Student Programs
Gupta, R., Kanade, A., & Shevade, S. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.3301930 · Cited by 54
Learning to Fix Build Errors with Graph2Diff Neural Networks
Tarlow, D., Moitra, S., Rice, A., Chen, Z., Manzagol, P.-A., Sutton, C., & Aftandilian, E. (2020) · Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops · doi:10.1145/3387940.3392181 · Cited by 54
Graying the black box: Understanding DQNs
Zahavy, T., Ben-Zrihem, N., & Mannor, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02658 · Cited by 54
Dynamic Neural Program Embedding for Program Repair
Wang, K., Singh, R. K., & Su, Z. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.07163 · Cited by 52 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodLearning a dual-language vector space for domain-specific cross-lingual question retrieval
Chen, G.-B., Chen, C., Xing, Z., & Xu, B. (2016) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2970276.2970317 · Cited by 50 · cited 1×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodConnecting software metrics across versions to predict defects
Liu, Y., Li, Y., Guo, J., Zhou, Y., & Xu, B. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330212 · Cited by 50
A deep neural network language model with contexts for source code
Nguyen, A. T., Nguyen, T. D., Phan, H., & Nguyen, T. N. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330220 · Cited by 48 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodNeural Sketch Learning for Conditional Program Generation
Murali, V., Qi, L., Chaudhuri, S., & Jermaine, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05698 · Cited by 47
Bilateral Dependency Neural Networks for Cross-Language Algorithm Classification
Bui, N. D. Q., Yu, Y., & Jiang, L. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8667995 · Cited by 47 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodBayesian specification learning for finding API usage errors
Murali, V., Chaudhuri, S., & Jermaine, C. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3106284 · Cited by 46 · cited 1×
“SE Task Papers Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Source Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-fixing Process [41, 67…”
MethodMa, L., Juefei-Xu, F., Sun, J., Chen, C., Su, T., Zhang, F., Xue, M., Li, B., Li, L., Liu, Y., et al. (2018) · arXiv (Cornell University) · Cited by 46
Learning Libraries of Subroutines for Neurally–Guided Bayesian Program Induction
Ellis, K., Morales, L., Sablé-Meyer, M., Solar-Lezama, A., & Tenenbaum, J. B. (2018) · neural information processing systems · Cited by 44
Keep it simple: Is deep learning good for linguistic smell detection?
Fakhoury, S., Arnaoudova, V., Noiseux, C., Khomh, F., & Antoniol, G. (2018) · IEEE International Conference on Software Analysis, Evolution, and Reengineering · doi:10.1109/saner.2018.8330265 · Cited by 43 · cited 4×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
BackgroundMethodInfluentialDeepLink: A Code Knowledge Graph Based Deep Learning Approach for Issue-Commit Link Recovery
Xie, R., Chen, L., Ye, W., Li, Z., Hu, T., Du, D., & Zhang, S. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8667969 · Cited by 43 · cited 5×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodInfluentialDynamic Neural Program Embeddings for Program RepairPreprint
Wang, K., Su, Z., & Singh, R. (2018) · arXiv (Cornell University) · Cited by 43
Leveraging Grammar and Reinforcement Learning for Neural Program Synthesis
Bunel, R., Hausknecht, M., Devlin, J., Singh, R. K., & Kohli, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04276 · Cited by 42 · cited 1×
“In addition to the aforementioned techniques, we found a subset of more unique approaches, including the use of deep reinforcement learning instead of supervised learning [162], gradient clipping, lifelong learning [58], modification of the loss function [20], pretraining [146, 162], and ensemble modeling [82].”
MethodNeural Guided Constraint Logic Programming for Program SynthesisPreprint
Zhang, L., Rosenblatt, G., Fetaya, E., Liao, R., Byrd, W. E., Might, M., Urtasun, R., & Zemel, R. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.02840 · Cited by 40 · cited 2×
“es, pretraining the model, and pruning the search space. From our SLR, the most commonly used underfitting techniques applied were pruning the search space of the model [29, 125], curriculum training [29, 107, 141] and pretraining [114, 127]. We found that only 6/84 primary studies explicitly stated the implementation…”
MethodA Neural Model for Method Name Generation from Functional Description
Gao, S., Chen, C., Xing, Z., Ma, Y., Song, W. W., & Lin, S. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8667994 · Cited by 40 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodMaybe Deep Neural Networks are the Best Choice for Modeling Source Code
Karampatsis, R.-M., & Sutton, C. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.05734 · Cited by 39
Open Vocabulary Learning on Source Code with a Graph-Structured CachePreprint
Cvitkovic, M. W., Singh, B., & Anandkumar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.08305 · Cited by 37 · cited 2×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodFeature Maps: A Comprehensible Software Representation for Design Pattern Detection
Thaller, H., Linsbauer, L., & Egyed, A. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8667978 · Cited by 37 · cited 3×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodAutomatic Program Synthesis of Long Programs with a Learned Garbage Collector
Zohar, A., & Wolf, L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04682 · Cited by 35 · cited 2×
“109, 121, 129, 134, 138] F1-Measure [8, 10, 30, 31, 36, 60, 65, 76, 77, 88, 121, 130, 134, 138, 142] Accuracy [14, 15, 17, 18, 25, 37–40, 50, 60, 63, 78, 79, 81, 86, 98, 99, 103, 107, 117, 138, 141] [9, 11, 12, 23, 28, 29, 32, 44, 49, 61, 62, 64, 65, 77, 83, 84, 101, 109, 113, 125, 128, 143] CIDER [127, 143] ROC [49,…”
MethodChen, C., Diao, W., Zeng, Y., Guo, S., & Hu, C. (2018) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2018.00014 · Cited by 35
Budhiraja, A., Dutta, K., Reddy, R., & Shrivastava, M. (2018) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3183440.3195092 · Cited by 34 · cited 4×
“MMR [24, 26, 34, 53, 63, 69, 75] BLEU Score [22, 27, 55, 61, 68, 127] METEOR Score [26, 126] Precision [8, 12, 30, 31, 36, 38, 53, 57, 60, 62, 65, 75, 77, 81, 84, 87, 97, 101, 109, 121, 122, 129, 134, 136, 138] Recall [8, 12, 16, 24, 30, 31, 36, 38, 57, 60, 62, 65, 77, 81, 84, 85, 88, 101, 109, 121, 129, 134, 138] F1-…”
MethodInfluentialExtracting API Tips from Developer Question and Answer Websites
Wang, S., Phan, N., Wang, Y., & Zhao, Y. (2019) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2019.00058 · Cited by 34 · cited 4×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
BackgroundMethodInfluentialDeep Learning & Software Engineering: State of Research and Future DirectionsPreprint
Dévanbu, P., Dwyer, M. B., Elbaum, S. G., Lowry, M., Moran, K., Poshyvanyk, D., Ray, B., Singh, R., & Zhang, X. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.08525 · Cited by 34 · cited 1×
“A recent report from the 2019 NSF Workshop on Deep Leaning & Software Engineering has referred to this area of work as Deep Learning for Software Engineering (DL4SE) [134].”
BackgroundSelf-citationDeep Green: Modelling Time-Series of Software Energy Consumption
Romansky, S., Borle, N. C., Chowdhury, S., Hindle, A., & Greiner, R. (2017) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2017.79 · Cited by 33 · cited 1×
“Smells [87] Mobile Testing [91] Traditional Software Testing [35, 51, 114] Non Code Related Software Artifacts [30–32, 68, 92, 112] Clone Detection [49, 81, 85, 109, 121, 136] Software Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To…”
MethodCombining Symbolic Expressions and Black-box Function Evaluations in Neural ProgramsPreprint
Arabshahi, F., Singh, S., & Anandkumar, A. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.04342 · Cited by 31
Towards Synthesizing Complex Programs from Input-Output Examples
Chen, X., Liu, C., & Song, D. X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.01284 · Cited by 31
Training Binary Classifiers as Data Structure Invariants
Molina, F., Degiovanni, R., Ponzio, P., Regis, G., Aguirre, N., & Frias, M. F. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00084 · Cited by 27 · cited 4×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodInfluentialDeep Learning in Software EngineeringPreprint
Li, X., Jiang, H., Ren, Z., Li, G., & Zhang, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.04825 · Cited by 25
Learning lenient parsing & typing via indirect supervision
Ahmed, T., Devanbu, P., & Hellendoorn, V. J. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-09942-y · Cited by 24
Panzeri, S., Magri, C., & Carraro, L. (2008) · Scholarpedia · doi:10.4249/scholarpedia.4258 · Cited by 24
Bui, N. D. Q., Jiang, L., & Yu, Y. (2018) · Singapore Management University Institutional Knowledge (InK) (Singapore Management University) · Cited by 22
Neural-augmented static analysis of Android communication
Zhao, J., Albarghouthi, A., Rastogi, V., Jha, S., & Octeau, D. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3236066 · Cited by 20 · cited 2×
“oftware Energy Metrics [108] Program Synthesis [12, 13, 17, 18, 29, 39, 40, 43, 44, 50, 64, 83, 86, 99, 107, 113, 117, 125, 141, 143] Image To Structured Representation [23, 37, 96] Software Security [21, 36, 49, 60, 61, 142] Program Repair [15, 61, 89, 123, 128] Software Reliability / Defect Prediction [58, 130, 134]…”
MethodAutomatic Categorization with Deep Neural Network for Open-Source Java Projects
Nguyen, A. T., & Nguyen, T. N. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-c.2017.118 · Cited by 18 · cited 2×
“Repair [15, 61, 89, 123, 128] Software Reliability / Defect Prediction [58, 130, 134] Feature Location [34] Developer Forum Analysis [25, 84, 95, 138] Program Translation [28] Software Categorization [11] Code Location Within Media [101] Developer Intention Mining [65] three main SE tasks that have remained the most a…”
MethodA Literature Review Study of Software Defect Prediction using Machine Learning Techniques
Akmel, F., Birihanu, E., & Siraj, B. (2018) · International Journal of Emerging Research in Management and Technology · doi:10.23956/ijermt.v6i6.286 · Cited by 18
Guo, C., Huang, D., Dong, N., Ye, Q., Xu, J., Fan, Y., Yang, H., & Xu, Y. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8668037 · Cited by 16 · cited 5×
“Code Comprehension [9, 10, 16, 64, 73, 77, 93, 97, 119, 121, 130, 144, 180, 185] Souce Code Generation [26, 37, 57, 63, 74, 84, 124, 136, 151, 173] Source Code Retrieval & Traceability [10, 27, 29, 41, 62, 65, 92, 175, 179] Source Code Summarization [11, 29, 77, 95, 162, 179] Bug-Fixing Process [41, 67, 68, 80, 92, 96…”
MethodInfluentialLearning to Align the Source Code to the Compiled Object Code
Levy, D., & Wolf, L. (2017) · International Conference on Machine Learning · Cited by 13
Predicting and Evaluating Software Model Growth in the Automotive Industry
Schroeder, J., Berger, C., Knauss, A., Preenja, H., Ali, M., Staron, M., & Herpel, T. (2017) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2017.41 · Cited by 10 · cited 1×
“Approximation Error Mean Absolute Error [33, 34] Minimum Absolute Difference [123] Macro-averaged Mean Absolute Error [32, 33] Root Mean Squared Error [143] Median Absolute Error [34] Macro-averaged Mean Cost Error [32]”
Hellendoorn, V. J., Dévanbu, P., & Alipour, M. A. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3264832 · Cited by 10 · cited 2×
“109, 121, 129, 134, 138] F1-Measure [8, 10, 30, 31, 36, 60, 65, 76, 77, 88, 121, 130, 134, 138, 142] Accuracy [14, 15, 17, 18, 25, 37–40, 50, 60, 63, 78, 79, 81, 86, 98, 99, 103, 107, 117, 138, 141] [9, 11, 12, 23, 28, 29, 32, 44, 49, 61, 62, 64, 65, 77, 83, 84, 101, 109, 113, 125, 128, 143] CIDER [127, 143] ROC [49,…”
MethodSoftware Engineering Meets Deep Learning: A Mapping StudyPreprint
Ferreira, F., Silva, L. L., & Valente, M. T. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.11436 · Cited by 9 · cited 2×
“[54] provide similar analysis to the paper presented by Li et al.”
BackgroundMethodEnhancing Explainability of Neural Networks through Architecture ConstraintsPreprint
Yang, Z., Zhang, A., & Sudjianto, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03838 · Cited by 8 · cited 1×
“Thus, there exists an open research problem related to being able to explain how a given model was capable of predicting the target function, specifically as it relates to SE data [12, 59, 174, 178, 182].”
BackgroundDSM: a specification mining tool using recurrent neural network based language model
Le, T.-D. B., Bao, L., & Lo, D. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3264597 · Cited by 7 · cited 2×
“53, 57, 60, 62, 65, 75, 77, 81, 84, 87, 97, 101, 109, 121, 122, 129, 134, 136, 138] Recall [8, 12, 16, 24, 30, 31, 36, 38, 57, 60, 62, 65, 77, 81, 84, 85, 88, 101, 109, 121, 129, 134, 138] F1-Measure [8, 10, 30, 31, 36, 60, 65, 76, 77, 88, 121, 130, 134, 138, 142] Accuracy [14, 15, 17, 18, 25, 37–40, 50, 60, 63, 78, 7…”
Background
Research works printed but not linked: 13
- Artifact Review and Badging – Version 2.0. Artifact Review and Badging – Version 2.0 Association for Computing Machinery 4 Nov. 2021 https://www.acm.org/publications/policies/artifact-review-badging.
- Tal Ben-Nun, Alice Shoshana Jakobovits, and Torsten Hoefler. 2018. Neural code comprehension: A learnable representation of code semantics. In Proceedings of the Annual Conference on Neural Information Processing Systems, Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicolò Cesa-Bianchi, and Roman Garnett (Eds.). 3589–3601. Retrieved from https://proceedings.neurips.cc/paper/2018/hash/17c3433fecc21b57000debdf7ad5c930-Abstract.html.
- Jacob Devlin, Rudy Bunel, Rishabh Singh, Matthew J. Hausknecht, and Pushmeet Kohli. 2017. Neural program meta-induction. In Proceedings of the Annual Conference on Neural Information Processing Systems, Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett (Eds.). 2080–2088. Retrieved from https://proceedings.neurips.cc/paper/2017/hash/3bf55bbad370a8fcad1d09b005e278c2-Abstract.html.
- Pedro Domingos. 1998. Occam’s two razors: The sharp and the blunt. In Proceedings of the 4th International Conference on Knowledge Discovery and Data Mining (KDD’98). AAAI Press, 37–43.
- 10.1109/MS.2017.265101102 · doi:10.1109/ms.2017.265101102
- 10.1609/aimag.v17i3.1230 · doi:10.1609/aimag.v17i3.1230
- 10.5555/3155562.3155573 · doi:10.5555/3155562.3155573
- 10.5555/3086952 · doi:10.5555/3086952
- 10.5555/3155562.3155583 · doi:10.5555/3155562.3155583
- B. Kitchenham and S. Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering (EBSE 2007-001). Keele University and Durham University Joint Report. Retrieved from https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf.
- 10.5555/971143 · doi:10.5555/971143
- J. Sayyad Shirabad and T. J. Menzies. 2005. The PROMISE repository of software engineering databases.School of Information Technology and Engineering, University of Ottawa, Canada. Retrieved from http://promise.site.uottawa.ca/SERepository.
- 10.5555/2820518.2820559 · doi:10.5555/2820518.2820559
Cited by
Large Language Models for Software Engineering: A Systematic Literature Review
Hou, X., Zhao, Y., Liu, Y., Yang, Z., Wang, K., Li, L., Luo, X., Lo, D., Grundy, J., & Wang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3695988 · Cited by 1,029
Software Testing With Large Language Models: Survey, Landscape, and Vision
Wang, J., Huang, Y., Chen, C., Liu, Z., Wang, S., & Wang, Q. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3368208 · Cited by 573
“Yang et al. and Watson et al. respectively carried out surveys about the use of deep learning in software engineering domain [161], [162].”
Automating code review activities by large-scale pre-training
Li, Z., Lu, S., Guo, D., Duan, N., Jannu, S., Jenks, G., Majumder, D., Green, J., Svyatkovskiy, A., Fu, S., et al. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549081 · Cited by 196
“Deep Learning techniques have been widely adopted in software engineering research [10, 44].”
MethodRetrieval-Based Prompt Selection for Code-Related Few-Shot Learning
Nashid, N., Sintaha, M., & Mesbah, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00205 · Cited by 178
“There is a large body of literature [74]–[78] that applies learning based task-specific models to different source code processing tasks.”
BackgroundRise of the Planet of Serverless Computing: A Systematic Review
Wen, J., Chen, Z., Jin, X., & Liu, X. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3579643 · Cited by 188
“In our study, seven standard online engines or databases [134, 172, 231, 254, 270] are selected as literature sources.”
BackgroundMethod
Metadata
- Authors
- Watson, C., Cooper, N., Palacio, D. N., Moran, K., & Poshyvanyk, D.
- Affiliations
- Washington and Lee University (US)
- William & Mary (US)
- George Mason University (US)
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 2022-03-04
- Volume
- 31
- Issue
- 2
- Pages
- 1-58
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W3084812981
- Cited by
- 137
- References
- 204
- Citations by year
- 2026: 21 · 2025: 39 · 2024: 37 · 2023: 30 · 2022: 8
- FWCI
- 3.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- ACM Transactions on Software Engineering and Methodology (publishedVersion)
- Funders
- NSF (CCF-1927679, CCF-1955853, CCF-2007246, and CCF-1815186)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Software › Advanced Software Engineering Methodologies
- Keywords
- deep learning, software engineering research, software development automation, automated feature engineering, machine learning in software engineering, research roadmap, software engineering tasks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.