The DOI matches its Crossref record; 80 of the 80 references it cites were found in a registry or an index.
CoCoNuT: combining context-aware neural translation models using ensemble for program repair
Abstract
Automated generate-and-validate (GV) program repair techniques (APR) typically rely on hard-coded rules, thus only fixing bugs following specific fix patterns. These rules require a significant amount of manual effort to discover and it is hard to adapt these rules to different programming languages.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,887
Effective Approaches to Attention-based Neural Machine Translation
Luong, T., Pham, H., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1166 · Cited by 8,382
Self-citationConvolutional Sequence to Sequence Learning
Gehring, J., Auli, M., Grangier, D., Yarats, D., & Dauphin, Y. N. (2017) · arXiv · doi:10.48550/arxiv.1705.03122 · Cited by 2,850 · cited 18×
“Figure 6 shows the same bug in both the Java (Figure 6a) and Python (Figure 6b) We compare CoCoNuT with DLFix [42] and SequenceR [13], two state-of-the-art NMT-based APR techniques and three other state-of-the-art NMT architectures (i.e., LSTM [56], Transformer [78], and FConv [20]).”
BackgroundMethodInfluentialDefects4J: a database of existing faults to enable controlled testing studies for Java programs
Just, R., Jalali, D., & Ernst, M. D. (2014) · Proceedings of the 2014 International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2628055 · Cited by 1,447
GenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085
code2vec: Learning distributed representations of code
Alon, U., Zilberstein, M., Levy, O., & Yahav, E. (2019) · Proceedings of the ACM on Programming Languages · doi:10.1145/3290353 · Cited by 962
Learning from massive noisy labeled data for image classification
Xiao, T., Xia, T., Yang, Y., Huang, C., & Wang, X. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298885 · Cited by 907
(2017) · International Conference on Machine Learning · Cited by 758
Automatically learning semantic features for defect prediction
Wang, S., Liu, T., & Tan, L. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884804 · Cited by 689
Self-citationA Convolutional Attention Network for Extreme Summarization of Source CodePreprint
Allamanis, M., Peng, H. M., & Sutton, C. A. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03001 · Cited by 624
Deep learning code fragments for code clone detection
White, M., Tufano, M., Vendome, C., & Poshyvanyk, D. (2016) · Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/2970276.2970326 · Cited by 558
Gu, X., Zhang, H., & Kim, S. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180167 · Cited by 547
Angelix: scalable multiline program patch synthesis via symbolic analysis
Mechtaev, S., Yi, J., & Roychoudhury, A. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884807 · Cited by 515
Software Defect Prediction via Convolutional Neural Network
Li, J., He, P., Zhu, J., & Lyu, M. R. (2017) · 2017 IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2017.42 · Cited by 462
Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs
Xuan, J., Martinez, M., DeMarco, F., Clement, M., Marcote, S. L., Durieux, T., Le Berre, D., & Monperrus, M. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2560811 · Cited by 430
DeepFix: Fixing Common C Language Errors by Deep Learning
Gupta, R., Pal, S., Kanade, A., & Shevade, S. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10742 · Cited by 426
An analysis of patch plausibility and correctness for generate-and-validate patch generation systems
Qi, Z., Long, F., Achour, S., & Rinard, M. (2015) · Proceedings of the 2015 International Symposium on Software Testing and Analysis · doi:10.1145/2771783.2771791 · Cited by 420
Perplexity—a measure of the difficulty of speech recognition tasks
Jelinek, F., Mercer, R. L., Bahl, L. R., & Baker, J. K. (1977) · The Journal of the Acoustical Society of America · doi:10.1121/1.2016299 · Cited by 398
Staged program repair with condition synthesis
Long, F., & Rinard, M. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786811 · Cited by 348
Le, X. B. D., Lo, D., & Le Goues, C. (2016) · 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER) · doi:10.1109/saner.2016.76 · Cited by 332
Dealing with noise in defect prediction
Kim, S., Zhang, H., Wu, R., & Gong, L. (2011) · Proceedings of the 33rd International Conference on Software Engineering · doi:10.1145/1985793.1985859 · Cited by 330
Shaping program repair space with existing patches and similar code
Jiang, J., Xiong, Y., Zhang, H., Gao, Q., & Chen, X. (2018) · Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3213846.3213871 · Cited by 329
Context-aware patch generation for better automated program repair
Wen, M., Chen, J., Wu, R., Hao, D., & Cheung, S.-C. (2018) · Proceedings of the 40th International Conference on Software Engineering · doi:10.1145/3180155.3180233 · Cited by 328
The ManyBugs and IntroClass benchmarks for automated repair of C programs
Le Goues, C., Holtschulte, N., Smith, E. K., Brun, Y., Devanbu, P., Forrest, S., & Weimer, W. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2015.2454513 · Cited by 326 · cited 5×
“On the ManyBugs benchmark, CoCoNuT fixes seven bugs, outperforming GenProg, Kali, and RSRepair but is outperformed by other techniques.”
MethodInfluentialTBar: revisiting template-based automated program repair
Liu, K., Koyuncu, A., Kim, D., & Bissyandé, T. F. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330577 · Cited by 321
Precise Condition Synthesis for Program Repair
Xiong, Y., Wang, J., Yan, R., Zhang, J., Han, S., Huang, G., & Zhang, L. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.45 · Cited by 299
Are deep neural networks the best choice for modeling source code?
Hellendoorn, V. J., & Devanbu, P. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106290 · Cited by 292
QuixBugs: a multi-lingual program repair benchmark set based on the quixey challenge
Lin, D., Koppel, J., Chen, A., & Solar-Lezama, A. (2017) · Proceedings Companion of the 2017 ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity · doi:10.1145/3135932.3135941 · Cited by 242
ASTOR: a program repair library for Java (demo)
Martinez, M., & Monperrus, M. (2016) · Proceedings of the 25th International Symposium on Software Testing and Analysis · doi:10.1145/2931037.2948705 · Cited by 235
Online Defect Prediction for Imbalanced Data
Tan, M., Tan, L., Dara, S., & Mayeux, C. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.139 · Cited by 229
Self-citationARJA: Automated Repair of Java Programs via Multi-Objective Genetic Programming
Yuan, Y., & Banzhaf, W. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2874648 · Cited by 224
A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction
Chollampatt, S., & Ng, H. T. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.12069 · Cited by 218
CCLearner: A Deep Learning-Based Clone Detection Approach
Li, L., Feng, H., Zhuang, W., Meng, N., & Ryder, B. (2017) · 2017 IEEE International Conference on Software Maintenance and Evolution (ICSME) · doi:10.1109/icsme.2017.46 · Cited by 214
DLFix: context-based code transformation learning for automated program repair
Li, Y., Wang, S., & Nguyen, T. N. (2020) · Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering · doi:10.1145/3377811.3380345 · Cited by 209
Self-citationGHTorrent: Github's data from a firehose
Gousios, G., & Spinellis, D. (2012) · 2012 9th IEEE Working Conference on Mining Software Repositories (MSR) · doi:10.1109/msr.2012.6224294 · Cited by 202
Liu, K., Koyuncu, A., Bissyandé, T. F., Kim, D., Klein, J., & Traon, Y. L. (2019) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2019.00020 · Cited by 194
Toward deep learning software repositories
White, M., Vendome, C., & Poshyvanyk, D. (2015) · Cited by 192
Elixir: Effective object-oriented program repair
Saha, R. K., Lyu, Y., Yoshida, H., & Prasad, M. R. (2017) · 2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115675 · Cited by 189
Automatic inference of code transforms for patch generation
Long, F., Amidon, P., & Rinard, M. (2017) · Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering · doi:10.1145/3106237.3106253 · Cited by 175
Liu, K., Wang, S., Koyuncu, A., Kim, K., Bissyandé, T. F., Kim, D., Wu, P., Klein, J., Mao, X., & Traon, Y. L. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377811.3380338 · Cited by 173
AVATAR: Fixing Semantic Bugs with Fix Patterns of Static Analysis Violations
Liu, K., Koyuncu, A., Kim, D., & Bissyande, T. F. (2019) · 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8667970 · Cited by 171
Bugs.jar: a large-scale, diverse dataset of real-world Java bugs
Saha, R. K., Lyu, Y., Lam, W., Yoshida, H., & Prasad, M. R. (2018) · Proceedings of the 15th International Conference on Mining Software Repositories · doi:10.1145/3196398.3196473 · Cited by 168
An Analysis of the Search Spaces for Generate and Validate Patch Generation Systems
Long, F., & Rinard, M. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884872 · Cited by 167
Building Program Vector Representations for Deep Learning
Peng, H. M., Mou, L., Li, G., Liu, Y., Zhang, L., & Jin, Z. G. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-25159-2_49 · Cited by 160
Online defect prediction for imbalanced data
Tan, M., Tan, L., Dara, S., & Mayeux, C. (2015) · doi:10.5555/2819009.2819026 · Cited by 151
Self-citationA Survey of Machine Learning for Big Code and Naturalness
Allamanis, M., Barr, E. T., Devanbu, P., & Sutton, C. (2019) · ACM Computing Surveys · doi:10.1145/3212695 · Cited by 150
Software reliability prediction using a deep learning model based on the RNN encoder–decoder
Wang, J., & Zhang, C. (2017) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2017.10.019 · Cited by 147
Tufano, M., Watson, C., Bavota, G., Penta, M. D., White, M., & Poshyvanyk, D. (2018) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3238147.3240732 · Cited by 144
DeepDelta: learning to repair compilation errors
Mesbah, A., Rice, A. C., Johnston, E., Glorioso, N., & Aftandilian, E. E. (2019) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3338906.3340455 · Cited by 138
Codeflaws: a programming competition benchmark for evaluating automated program repair tools
Tan, S. H., Yi, J., Yulis, Mechtaev, S., & Roychoudhury, A. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-c.2017.76 · Cited by 136
Mining stackoverflow for program repair
Liu, X., & Zhong, H. (2018) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2018.8330202 · Cited by 134
Proceedings of the 38th International Conference on Software Engineering Companion
Dillon, L. A., Visser, W., & Williams, L. A. (2016) · doi:10.1145/2889160 · Cited by 133
Better test cases for better automated program repair
Yang, J., Zhikhartsev, A., Liu, Y., & Tan, L. (2017) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3106237.3106274 · Cited by 130
Self-citationiFixR: bug report driven program repair
Koyuncu, A., Liu, K., Bissyandé, T. F., Kim, D., Monperrus, M., Klein, J., & Traon, Y. L. (2019) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3338906.3338935 · Cited by 126
Contract-based program repair without the contracts
Chen, L., Pei, Y., & Furia, C. A. (2017) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2017.8115674 · Cited by 122
Neural Sketch Learning for Conditional Program GenerationPreprint
Murali, V., Qi, L., Chaudhuri, S., & Jermaine, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05698 · Cited by 119
Fluency Boost Learning and Inference for Neural Grammatical Error Correction
Ge, T., Wei, F., & Zhou, M. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1097 · Cited by 119
Harnessing Evolution for Multi-Hunk Program Repair
Saha, S., Saha, R. K., & Prasad, M. R. (2019) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2019.00020 · Cited by 117
Discovering bug patterns in JavaScript
Hanam, Q., Brito, F. S. D. M., & Mesbah, A. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2950308 · Cited by 116
BEARS: An Extensible Java Bug Benchmark for Automatic Program Repair Studies
Madeiral, F., Urli, S., Maia, M., & Monperrus, M. (2019) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner.2019.8667991 · Cited by 116
Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical StudyPreprint
Ge, T., Wei, F., & Zhou, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.01270 · Cited by 106
Bears: An Extensible Java Bug Benchmark for Automatic Program Repair Studies
Madeiral, F., Urli, S., Maia, M., & Monperrus, M. (2019) · HAL · Cited by 106
BugsJS: a Benchmark of JavaScript Bugs
Gyimesi, P., Vancsics, B., Stocco, A., Mazinanian, D., Beszédes, Á., Ferenć, R., & Mesbah, A. (2019) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2019.00019 · Cited by 100
Durieux, T., & Monperrus, M. (2016) · International Workshop on Automation of Software Test (AST) · doi:10.1145/2896921.2896931 · Cited by 95
SOSRepair: Expressive Semantic Search for Real-World Program Repair
Afzal, A., Motwani, M., Stolee, K. T., Brun, Y., & Goues, C. L. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2944914 · Cited by 72
LSRepair: Live Search of Fix Ingredients for Automated Program Repair
Liu, K., Koyuncu, A., Kim, K., Kim, D., & Bissyandé, T. F. (2018) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec.2018.00085 · Cited by 70
On End-to-End Program Generation from User Intention by Deep Neural NetworksPreprint
Mou, L., Men, R., Li, G., Zhang, L., & Jin, Z. G. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.07211 · Cited by 59
Adapting Sequence Models for Sentence Correction
Schmaltz, A., Kim, Y., Rush, A. M., & Shieber, S. M. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1298 · Cited by 59
Grammatical Error Correction with Neural Reinforcement LearningPreprint
Sakaguchi, K., Post, M., & Durme, B. V. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.00299 · Cited by 56
Neural Sequence-Labelling Models for Grammatical Error Correction
Yannakoudakis, H., Rei, M., Andersen, Ø. E., & Yuan, Z. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1297 · Cited by 50
Vejovis: suggesting fixes for JavaScript faults
Ocariza, F. S., Pattabiraman, K., & Mesbah, A. (2014) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/2568225.2568257 · Cited by 49
SketchFix: a tool for automated program repair approach using lazy candidate generation
Hua, J., Zhang, M., Wang, K., & Sarfraz Khurshid, D. (2018) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3236024.3264600 · Cited by 37
Automatic patch generation with context-based change application
Kim, J., & Kim, S. (2019) · Empirical Software Engineering · doi:10.1007/s10664-019-09742-5 · Cited by 34
Exploiting Unlabeled Data for Neural Grammatical Error Detection
Liu, Z., & Liu, Y. (2017) · Journal of Computer Science and Technology · doi:10.1007/s11390-017-1757-4 · Cited by 29
Asad, M., Ganguly, K. K., & Sakib, K. M. (2019) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2019.00050 · Cited by 16
Finding and correcting syntax errors using recurrent neural networksPreprint
Santos, E. A., Campbell, J. C., Hindle, A., & Amaral, J. N. (2017) · doi:10.7287/peerj.preprints.3123v1 · Cited by 13
Guided code synthesis using deep neural networks
Alexandru, C. V. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2983951 · Cited by 11
Cited by
Unified Pre-training for Program Understanding and Generation
Ahmad, W., Chakraborty, S., Ray, B., & Chang, K.-W. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.211 · Cited by 642
Automated Program Repair in the Era of Large Pre-trained Language Models
Xia, C. S., Wei, Y., & Zhang, L. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00129 · Cited by 433
An Analysis of the Automatic Bug Fixing Performance of ChatGPT
Sobania, D., Briesch, M., Hanna, C., & Petke, J. (2023) · 2023 IEEE/ACM International Workshop on Automated Program Repair (APR) · doi:10.1109/apr59189.2023.00012 · Cited by 338
CURE: Code-Aware Neural Machine Translation for Automatic Program Repair
Jiang, N., Lutellier, T., & Tan, L. (2021) · 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) · doi:10.1109/icse43902.2021.00107 · Cited by 290
Self-citationAutomated Repair of Programs from Large Language Models
Fan, Z., Gao, X., Mirchev, M., Roychoudhury, A., & Tan, S. H. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00128 · Cited by 256
Metadata
- Authors
- Lutellier, T., Pham, H. V., Pang, L., Li, Y., Wei, M., & Tan, L.
- Venue
- Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis
- Publisher
- ACM
- Published
- 2020-07-18
- Pages
- 101-114
- OpenAlex
- W3043761819
- Cited by
- 344
- References
- 80
- FWCI
- 29.07
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.