The DOI matches its Crossref record; 123 of the 123 references it cites were found in a registry or an index.
Automatic Software Repair: A Survey
Open accessAbstract
Despite their growing complexity and increasing size, modern software applications must satisfy strict release requirements that impose short bug fixing and maintenance cycles, putting significant pressure on developers who are responsible for timely producing high-quality software. To reduce developers workload, repairing and healing techniques have been extensively investigated as solutions for efficiently repairing and maintaining software in the last few years. In particular, repairing solutions have been able to automatically produce useful fixes for several classes of bugs that might be present in software programs. A range of algorithms, techniques, and heuristics have been integrated, experimented, and studied, producing a heterogeneous and articulated research framework where automatic repair techniques are proliferating. This paper organizes the knowledge in the area by surveying a body of 108 papers about automatic software repair techniques, illustrating the algorithms and the approaches, comparing them on representative examples, and discussing the open challenges and the empirical evidence reported so far.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Symbolic execution and program testing
King, J. C. (1976) · Communications of the ACM · doi:10.1145/360248.360252 · Cited by 3,031
Defects4J: a database of existing faults to enable controlled testing studies for Java programs
Just, R., Jalali, D., & Ernst, M. D. (2014) · Proceedings of the 2014 International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2628055 · Cited by 1,447
Prioritizing test cases for regression testing
Rothermel, G., Untch, R. H., Chu, C., & Harrold, M. J. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.962562 · Cited by 1,338
Empirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,238
The oracle problem in software testing: A survey
Barr, E. T., Harman, M., McMinn, P., Shahbaz, M., & Yoo, S. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2372785 · Cited by 1,104
GenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085
Simplifying and isolating failure-inducing input
Zeller, A., & Hildebrandt, R. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988498 · Cited by 1,079
Dynamically discovering likely program invariants to support program evolution
Ernst, M. D., Cockrell, J., Griswold, W. G., & Notkin, D. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.908957 · Cited by 1,050
Pinpoint: problem determination in large, dynamic Internet services
Chen, M. Y., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2003) · Proceedings International Conference on Dependable Systems and Networks · doi:10.1109/dsn.2002.1029005 · Cited by 835
Automatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
On the Accuracy of Spectrum-based Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2007) · Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007) · doi:10.1109/taic.part.2007.13 · Cited by 736
Alur, R., Bodik, R., Juniwal, G., Martin, M. M. K., Raghothaman, M., Seshia, S. A., Singh, R., Solar-Lezama, A., Torlak, E., & Udupa, A. (2013) · 2013 Formal Methods in Computer-Aided Design · doi:10.1109/fmcad.2013.6679385 · Cited by 656
An experimental determination of sufficient mutant operators
Offutt, A. J., Lee, A., Rothermel, G., Untch, R. H., & Zapf, C. (1996) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/227607.227610 · Cited by 650
Angelix: scalable multiline program patch synthesis via symbolic analysis
Mechtaev, S., Yi, J., & Roychoudhury, A. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884807 · Cited by 515
Oracle-guided component-based program synthesis
Jha, S., Gulwani, S., Seshia, S. A., & Tiwari, A. (2010) · Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 · doi:10.1145/1806799.1806833 · Cited by 510
Automatic patch generation by learning correct code
Long, F., & Rinard, M. (2016) · Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages · doi:10.1145/2837614.2837617 · Cited by 481
Scalable statistical bug isolation
Liblit, B., Naik, M., Zheng, A. X., Aiken, A., & Jordan, M. I. (2005) · Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation · doi:10.1145/1065010.1065014 · Cited by 472
Automatic patch generation learned from human-written patches
Kim, D., Nam, J., Song, J., & Kim, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606626 · Cited by 449
An empirical study of cryptographic misuse in android applications
Egele, M., Brumley, D., Fratantonio, Y., & Kruegel, C. (2013) · Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security - CCS '13 · doi:10.1145/2508859.2516693 · Cited by 435
Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs
Xuan, J., Martinez, M., DeMarco, F., Clement, M., Marcote, S. L., Durieux, T., Le Berre, D., & Monperrus, M. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2560811 · Cited by 430
An analysis of patch plausibility and correctness for generate-and-validate patch generation systems
Qi, Z., Long, F., Achour, S., & Rinard, M. (2015) · Proceedings of the 2015 International Symposium on Software Testing and Analysis · doi:10.1145/2771783.2771791 · Cited by 420
Automatic generation of software behavioral models
Lorenzoli, D., Mariani, L., & Pezzè, M. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368157 · Cited by 416
Self-citationAutomatically patching errors in deployed software
Perkins, J. H., Kim, S., Larsen, S., Amarasinghe, S., Bachrach, J., Carbin, M., Pacheco, C., Sherwood, F., Sidiroglou, S., Sullivan, G., et al. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629585 · Cited by 409
Spectrum-Based Multiple Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2009) · 2009 IEEE/ACM International Conference on Automated Software Engineering · doi:10.1109/ase.2009.25 · Cited by 401
SemFix: Program repair via semantic analysis
Nguyen, H. D. T., Qi, D., Roychoudhury, A., & Chandra, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606623 · Cited by 395
SOBER: statistical model-based bug localization
Liu, C., Yan, X., Fei, L., Han, J., & Midkiff, S. P. (2005) · Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1081706.1081753 · Cited by 357
Staged program repair with condition synthesis
Long, F., & Rinard, M. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786811 · Cited by 348
Software testing and analysis: process, principles, and techniques
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0935 · Cited by 340
CTrigger: exposing atomicity violation bugs from their hiding places
Park, S., Lu, S., & Zhou, Y. (2009) · Proceedings of the 14th international conference on Architectural support for programming languages and operating systems · doi:10.1145/1508244.1508249 · Cited by 339
Le, X. B. D., Lo, D., & Le Goues, C. (2016) · 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER) · doi:10.1109/saner.2016.76 · Cited by 332
The ManyBugs and IntroClass benchmarks for automated repair of C programs
Le Goues, C., Holtschulte, N., Smith, E. K., Brun, Y., Devanbu, P., Forrest, S., & Weimer, W. (2015) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2015.2454513 · Cited by 326
A systematic study of automated program repair: Fixing 55 out of 105 bugs for $8 each
Le Goues, C., Dewey-Vogt, M., Forrest, S., & Weimer, W. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227211 · Cited by 326
Is the cure worse than the disease? overfitting in automated program repair
Smith, E. K., Barr, E. T., Le Goues, C., & Brun, Y. (2015) · Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering · doi:10.1145/2786805.2786825 · Cited by 323
Self-healing systems — survey and synthesis
Ghosh, D., Sharman, R., Raghav Rao, H., & Upadhyaya, S. (2007) · Decision Support Systems · doi:10.1016/j.dss.2006.06.011 · Cited by 305
The strength of random search on automated program repair
Qi, Y., Mao, X., Lei, Y., Dai, Z., & Wang, C. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568254 · Cited by 303
Software debugging, testing, and verification
Hailpern, B., & Santhanam, P. (2002) · IBM Systems Journal · doi:10.1147/sj.411.0004 · Cited by 303
Leveraging program equivalence for adaptive program repair: Models and first results
Weimer, W., Fry, Z. P., & Forrest, S. (2013) · 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693094 · Cited by 266
Software aspects of strategic defense systems
Parnas, D. L. (1985) · Communications of the ACM · doi:10.1145/214956.214961 · Cited by 260
A novel co-evolutionary approach to automatic software bug fixing
Arcuri, A., & Yao, X. (2008) · 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) · doi:10.1109/cec.2008.4630793 · Cited by 250
DirectFix: Looking for Simple Program Repairs
Mechtaev, S., Yi, J., & Roychoudhury, A. (2015) · 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering · doi:10.1109/icse.2015.63 · Cited by 250
A genetic programming approach to automated software repair
Forrest, S., Nguyen, T., Weimer, W., & Le Goues, C. (2009) · Proceedings of the 11th Annual conference on Genetic and evolutionary computation · doi:10.1145/1569901.1570031 · Cited by 236
Automated fixing of programs with contracts
Wei, Y., Pei, Y., Furia, C. A., Silva, L. S., Buchholz, S., Meyer, B., & Zeller, A. (2010) · Proceedings of the 19th international symposium on Software testing and analysis · doi:10.1145/1831708.1831716 · Cited by 235
A family of code coverage-based heuristics for effective fault localization
Eric Wong, W., Debroy, V., & Choi, B. (2010) · Journal of Systems and Software · doi:10.1016/j.jss.2009.09.037 · Cited by 230
Using Mutation to Automatically Suggest Fixes for Faulty Programs
Debroy, V., & Wong, W. E. (2010) · 2010 Third International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2010.66 · Cited by 226
FlashMeta: a framework for inductive program synthesis
Polozov, O., & Gulwani, S. (2015) · Proceedings of the 2015 ACM SIGPLAN International Conference on Object-Oriented Programming, Systems, Languages, and Applications · doi:10.1145/2814270.2814310 · Cited by 225
Jobstmann, B., Griesmayer, A., & Bloem, R. (2005) · Lecture Notes in Computer Science · doi:10.1007/11513988_23 · Cited by 223
Extraction of bug localization benchmarks from history
Dallmeier, V., & Zimmermann, T. (2007) · Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering · doi:10.1145/1321631.1321702 · Cited by 216
The plastic surgery hypothesis
Barr, E. T., Brun, Y., Devanbu, P., Harman, M., & Sarro, F. (2014) · Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering · doi:10.1145/2635868.2635898 · Cited by 215
FlashExtract: a framework for data extraction by examples
Le, V., & Gulwani, S. (2014) · Proceedings of the 35th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/2594291.2594333 · Cited by 209
Multithreaded Java program test generation
Edelstein, O., Farchi, E., Nir-Buchbinder, Y., Ratsaby, G., & Ur, S. (2002) · IBM Systems Journal · doi:10.1147/sj.411.0111 · Cited by 208
Verified Models and Reference Implementations for the TLS 1.3 Standard Candidate
Bhargavan, K., Blanchet, B., & Kobeissi, N. (2017) · 2017 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2017.26 · Cited by 205
Repairing Programs with Semantic Code Search (T)
Ke, Y., Stolee, K. T., Goues, C. L., & Brun, Y. (2015) · 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.60 · Cited by 192
Mining object behavior with ADABU
Dallmeier, V., Lindig, C., Wasylkowski, A., & Zeller, A. (2006) · Proceedings of the 2006 international workshop on Dynamic systems analysis · doi:10.1145/1138912.1138918 · Cited by 184
A survey on self-healing systems: approaches and systems
Psaier, H., & Dustdar, S. (2011) · Computing · doi:10.1007/s00607-010-0107-y · Cited by 183
Current challenges in automatic software repair
Le Goues, C., Forrest, S., & Weimer, W. (2013) · Software Quality Journal · doi:10.1007/s11219-013-9208-0 · Cited by 182
MAPE-K Formal Templates to Rigorously Design Behaviors for Self-Adaptive Systems
Iglesia, D. G. D. L., & Weyns, D. (2015) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/2724719 · Cited by 167
An Analysis of the Search Spaces for Generate and Validate Patch Generation Systems
Long, F., & Rinard, M. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884872 · Cited by 167
Monperrus, M. (2014) · Proceedings of the 36th International Conference on Software Engineering · doi:10.1145/2568225.2568324 · Cited by 166
Yesterday, my Program Worked. Today, it Does Not. Why?
Zeller, A. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48166-4_16 · Cited by 156
Static Contract Checking with Abstract Interpretation
Fähndrich, M. A., & Logozzo, F. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-18070-5_2 · Cited by 153
Automated Fixing of Programs with Contracts
Pei, Y., Furia, C. A., Nordio, M., Wei, Y., Meyer, B., & Zeller, A. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2014.2312918 · Cited by 152
Automated atomicity-violation fixing
Jin, G., Song, L., Zhang, W., Lu, S., & Liblit, B. (2011) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/1993498.1993544 · Cited by 151
Automatic repair of buggy if conditions and missing preconditions with SMT
DeMarco, F., Xuan, J., Berre, D. L., & Monperrus, M. (2014) · doi:10.1145/2593735.2593740 · Cited by 141
Anti-patterns in search-based program repair
Tan, S. H., Yoshida, H., Prasad, M. R., & Roychoudhury, A. (2016) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2950290.2950295 · Cited by 140
Countering Network Worms Through Automatic Patch Generation
Sidiroglou, S., & Keromytis, A. D. (2005) · IEEE Security & Privacy · doi:10.1109/msp.2005.144 · Cited by 136
Automated Identification of Failure Causes in System Logs
Mariani, L., & Pastore, F. (2008) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2008.48 · Cited by 130
Self-citationOn the automation of fixing software bugs
Arcuri, A. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1370175.1370223 · Cited by 125
Mining software repair models for reasoning on the search space of automated program fixing
Martínez, M., & Monperrus, M. (2013) · Empirical Software Engineering · doi:10.1007/s10664-013-9282-8 · Cited by 125
Weimer, W. R. (2006) · International Conference on Generative Programming and Component Engineering (GPCE) · doi:10.1145/1173706.1173734 · Cited by 123
Generating Fixes from Object Behavior Anomalies
Dallmeier, V., Zeller, A., & Meyer, B. (2009) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2009.15 · Cited by 123
A human study of patch maintainability
Fry, Z. P., Landau, B., & Weimer, W. R. (2012) · International Symposium on Software Testing and Analysis · doi:10.1145/2338965.2336775 · Cited by 122
CoREBench: studying complexity of regression errors
Böhme, M., & Roychoudhury, A. (2014) · International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2628058 · Cited by 121
Dynamic Analysis for Diagnosing Integration Faults
Mariani, L., Pastore, F., & Pezzè, M. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.93 · Cited by 121
Self-citationAutomatic error elimination by horizontal code transfer across multiple applications
Sidiroglou, S., Lahtinen, E., Long, F., & Rinard, M. (2015) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/2737924.2737988 · Cited by 117
Automatic recovery from runtime failures
Carzaniga, A., Gorla, A., Mattavelli, A., Perino, N., & Pezzè, M. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606624 · Cited by 116
Martínez, M., Weimer, W., & Monperrus, M. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2591062.2591114 · Cited by 113
Evolutionary repair of faulty software
Arcuri, A. (2011) · Applied Soft Computing · doi:10.1016/j.asoc.2011.01.023 · Cited by 112
Assertions are strongly correlated with test suite effectiveness
Zhang, Y., & Mesbah, A. (2015) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2786805.2786858 · Cited by 110
Using automated program repair for evaluating the effectiveness of fault localization techniques
Qi, Y., Mao, X., Lei, Y., & Wang, C. (2013) · International Symposium on Software Testing and Analysis · doi:10.1145/2483760.2483785 · Cited by 99
Efficient Automated Program Repair through Fault-Recorded Testing Prioritization
Qi, Y., Mao, X., & Lei, Y. (2013) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2013.29 · Cited by 99
Enhancing model checking in verification by AI techniques
Buccafurri, F., Eiter, T., Gottlob, G., & Leone, N. (1999) · Artificial Intelligence · doi:10.1016/s0004-3702(99)00039-9 · Cited by 97
Durieux, T., & Monperrus, M. (2016) · International Workshop on Automation of Software Test (AST) · doi:10.1145/2896921.2896931 · Cited by 95
R2Fix: Automatically Generating Bug Fixes from Bug Reports
Liu, C., Yang, J., Tan, L., & Hafiz, M. (2013) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2013.24 · Cited by 93
MintHint: automated synthesis of repair hints
Kaleeswaran, S., Tulsian, V., Kanade, A., & Orso, A. (2014) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2568225.2568258 · Cited by 92
Fixing Recurring Crash Bugs via Analyzing Q&A Sites (T)
Gao, Q. Z., Zhang, H., Wang, J., Xiong, Y., Zhang, L., & Mei, H. (2015) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2015.81 · Cited by 86
Automatic mining of specifications from invocation traces and method invariants
Krka, I., Brun, Y., & Medvidović, N. (2014) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2635868.2635890 · Cited by 85
Modular and verified automatic program repair
Logozzo, F., & Ball, T. (2012) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2384616.2384626 · Cited by 81
BugFix: A learning-based tool to assist developers in fixing bugs
Jeffrey, D., Feng, M., Gupta, N., & Gupta, R. (2009) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2009.5090029 · Cited by 81
Automatically generated patches as debugging aids: a human study
Tao, Y., Kim, J., Kim, S., & Xu, C. (2014) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2635868.2635873 · Cited by 77
Staber, S., Jobstmann, B., & Bloem, R. (2005) · Lecture notes in computer science · doi:10.1007/11560548_6 · Cited by 75
CARAMEL: Detecting and Fixing Performance Problems That Have Non-Intrusive Fixes
Nistor, A., Chang, P.-C., Radoi, C., & Lu, S. (2015) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2015.100 · Cited by 75
Representations and operators for improving evolutionary software repair
Goues, C. L., Weimer, W. R., & Forrest, S. (2012) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2330163.2330296 · Cited by 74
Automated program repair through the evolution of assembly code
Schulte, E., Forrest, S., & Weimer, W. R. (2010) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/1858996.1859059 · Cited by 73
relifix: Automated Repair of Software Regressions
Tan, S. H., & Roychoudhury, A. (2015) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1109/icse.2015.65 · Cited by 69
Why Programs Fail, Second Edition: A Guide to Systematic Debugging
Zeller, A. (2009) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 66
Automatic Software Repair: a BibliographyPreprint
Monperrus, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00515 · Cited by 66
Automated repair of HTML generation errors in PHP applications using string constraint solving
Samimi, H., Schäfer, M., Artzi, S., Millstein, T. D., Tip, F., & Hendren, L. J. (2012) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1109/icse.2012.6227186 · Cited by 66
Fix Me Up: Repairing Access-Control Bugs in Web Applications
Son, S., McKinley, K. S., & Shmatikov, V. (2013) · Cited by 64
Designing better fitness functions for automated program repair
Fast, E., Goues, C. L., Forrest, S., & Weimer, W. R. (2010) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1830483.1830654 · Cited by 61
ConcBugAssist: constraint solving for diagnosis and repair of concurrency bugs
Khoshnood, S., Kusano, M., & Wang, C. (2015) · International Symposium on Software Testing and Analysis · doi:10.1145/2771783.2771798 · Cited by 58
Assertion-based repair of complex data structures
Elkarablieh, B., García, I., Suen, Y. L., & Sarfraz Khurshid, D. (2007) · doi:10.1145/1321631.1321643 · Cited by 57
Fault-localization techniques for software systems
Agarwal, P., & Agrawal, A. P. (2014) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/2659118.2659125 · Cited by 54
Grail: context-aware fixing of concurrency bugs
Liu, P., Tripp, O., & Zhang, C. (2014) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2635868.2635881 · Cited by 53
Babenko, A., Mariani, L., & Pastore, F. (2009) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/1572272.1572300 · Cited by 51
Self-citationAxis: Automatically fixing atomicity violations through solving control constraints
Liu, P., & Zhang, C. (2012) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1109/icse.2012.6227184 · Cited by 47
Semantic differential repair for input validation and sanitization
Alkhalaf, M., Aydin, A., & Bultan, T. (2014) · International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2610401 · Cited by 44
Targeted Automatic Integer Overflow Discovery Using Goal-Directed Conditional Branch Enforcement
Sidiroglou, S., Lahtinen, E., Rittenhouse, N., Piselli, P., Long, F., Kim, D., & Rinard, M. (2015) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/2694344.2694389 · Cited by 40
Detecting and Escaping Infinite Loops with Jolt
Carbin, M., Misailovíc, S., Kling, M., & Rinard, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22655-7_28 · Cited by 38
Program transformations to fix C integers
Coker, Z., & Hafiz, M. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606625 · Cited by 38
Gabel, M., & Su, Z. (2012) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/2393596.2393598 · Cited by 34
Experience report: How do techniques, programs, and tests impact automated program repair?
Kong, X., Zhang, L., Wong, W. E., & Li, B. (2015) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2015.7381813 · Cited by 34
Automatic repair for multi-threaded programs with Deadlock/Livelock using maximum satisfiability
Lin, Y., & Kulkarni, S. S. (2014) · International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2610398 · Cited by 33
Automated Program Repair by Using Similar Code Containing Fix Ingredients
Ji, T., Chen, L., Mao, X., & Yi, X. (2016) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2016.69 · Cited by 33
Automatic Workarounds: Exploiting the Intrinsic Redundancy of Web Applications
Carzaniga, A., Gorla, A., Perino, N., & Pezzè, M. (2015) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2755970 · Cited by 30
Multi-objective coevolutionary automated software correction
Wilkerson, J. L., Tauritz, D. R., & Bridges, J. M. (2012) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2330163.2330333 · Cited by 30
On the techniques we create, the tools we build, and their misalignments
Rizzi, E. F., Elbaum, S. G., & Dwyer, M. B. (2016) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/2884781.2884835 · Cited by 21
Automatic Program Repair Using Genetic Programming
Goues, C. L. (2013) · doi:10.18130/v3kz3c · Cited by 20
Automatic Repair of Infinite LoopsPreprint
Marcote, S. R. L., & Monperrus, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1504.05078 · Cited by 18
Towards efficient and effective automatic program repair
Le, X.-B. D. (2016) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2970276.2975934 · Cited by 16
Toward improving ability to repair bugs automatically
Yokoyama, H., Higo, Y., Hotta, K., Ohta, T., Okano, K., & Kusumoto, S. (2016) · ACM Symposium on Applied Computing · doi:10.1145/2851613.2851770 · Cited by 11
A Capable Crossover Technique on Automatic Program Repair
Ryotaro, K., Higo, Y., & Kusumoto, S. (2016) · International Workshop on Empirical Software Engineering in Practice (IWESEP) · doi:10.1109/iwesep.2016.15 · Cited by 9
On the evaluation of automatic program repair techniques and tools
Khalilian, A., Baraani-Dastjerdi, A., & Zamani, B. (2016) · Iranian Conference on Electrical Engineering · doi:10.1109/iraniancee.2016.7585390 · Cited by 6
Prophet: Automatic Patch Generation via Learning from Successful Patches
Long, F., & Rinard, M. (2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 6
Research works printed but not linked: 49
- 10.1109/COMPSAC.2013.139 · doi:10.1109/compsac.2013.139
- 10.1109/ISSRE.2015.7381836 · DOI
- 10.1109/ICSM.2015.7332504 · doi:10.1109/icsm.2015.7332504
- 10.1007/978-3-642-39955-8_7 · doi:10.1007/978-3-642-39955-8_7
- bradbury, 2010, Automatic repair of concurrency bugs, Proc 2nd Int Symp Search Based Software Eng, 73
- 10.1109/ICST.2014.40 · doi:10.1109/icst.2014.40
- monperrus, 2013, Two flavors in automated software repair: Rigid repair and plastic repair, Dagstuhl Seminar n 13061 “Fault Prediction Localization and Repair”
- 10.1145/2001576.2001768 · DOI
- 10.1109/ICSE.2015.260 · doi:10.1109/icse.2015.260
- 10.1109/ASE.2009.92 · DOI
- 10.1145/2897845.2897896 · doi:10.1145/2897845.2897896
- 10.1016/S0747-7171(85)80010-9 · doi:10.1016/s0747-7171(85)80010-9
- 10.1109/ICSE.2015.64 · doi:10.1109/icse.2015.64
- 10.1145/2884781.2884819 · doi:10.1145/2884781.2884819
- 10.1145/2931037.2931050 · DOI
- 10.1145/1321631.1321693 · DOI
- 10.1109/ICCIS.2013.490 · doi:10.1109/iccis.2013.490
- 10.1145/1006147.1006165 · doi:10.1145/1006147.1006165
- dennis, 2006, Proof-directed debugging and repair, Proc Symp Trends Functional Program, 131
- 10.1007/978-3-540-92814-0_36 · doi:10.1007/978-3-540-92814-0_36
- 10.1145/1273442.1250746 · doi:10.1145/1273442.1250746
- 10.1109/SEAMS.2017.9 · doi:10.1109/seams.2017.9
- jacob, 2004, A Practical Guide to the IBM Autonomic Computing Toolkit
- 10.1007/11498490_24 · doi:10.1007/11498490_24
- 10.1145/2351676.2351735 · doi:10.1145/2351676.2351735
- 10.1145/2666356.2594335 · doi:10.1145/2666356.2594335
- 10.1007/978-3-642-16612-9_28 · doi:10.1007/978-3-642-16612-9_28
- jin, 2012, Automated concurrency-bug fixing., Proc USENIX Symp on Operating System Design and Implementation, 221
- 10.1145/2950290.2950309 · doi:10.1145/2950290.2950309
- stumptner, 1996, Model-based program debugging and repair, Proc Int Conf Ind Eng Other Appl Appl Intell Syst, 155
- 10.1145/1985793.1985828 · doi:10.1145/1985793.1985828
- 10.1145/1735223.1735249 · doi:10.1145/1735223.1735249
- 10.1109/ICSE.2015.222 · doi:10.1109/icse.2015.222
- 10.1007/978-3-540-73986-9_2 · doi:10.1007/978-3-540-73986-9_2
- 10.1145/2970276.2970282 · doi:10.1145/2970276.2970282
- 10.1145/2001858.2001995 · doi:10.1145/2001858.2001995
- 10.1109/ASE.2011.6100080 · doi:10.1109/ase.2011.6100080
- 10.1145/2483760.2483785 · DOI
- 10.1145/2499368.2451151 · doi:10.1145/2499368.2451151
- 10.1109/ICSESS.2013.6615295 · doi:10.1109/icsess.2013.6615295
- 10.1109/ICSM.2012.6405280 · doi:10.1109/icsm.2012.6405280
- 10.1145/1830483.1830739 · doi:10.1145/1830483.1830739
- 10.1145/587052.587053 · doi:10.1145/587052.587053
- zuddas, 2014, MIMIC: locating and understanding bugs by analyzing mimicked executions, Proc IEEE Int Conf Automated Software Engineering, 815
- 10.1145/1229285.1267001 · doi:10.1145/1229285.1267001
- 10.1145/1508284.1508250 · doi:10.1145/1508284.1508250
- 10.1109/ICDSC.2001.918971 · doi:10.1109/icdsc.2001.918971
- 10.1145/2522920.2522923 · doi:10.1145/2522920.2522923
- 10.1109/IAS.2007.87 · doi:10.1109/ias.2007.87
Cited by
Demystifying LLM-Based Software Engineering Agents
Xia, C. S., Deng, Y., Dunn, S., & Zhang, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3715754 · Cited by 849
Automated Program Repair in the Era of Large Pre-trained Language Models
Xia, C. S., Wei, Y., & Zhang, L. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00129 · Cited by 433
Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code
Pan, R., Ibrahimzada, A. R., Krishna, R., Sankar, D., Wassi, L. P., Merler, M., Sobolev, B., Pavuluri, R., Sinha, S., & Jabbarvand, R. (2024) · Proceedings of the IEEE/ACM 46th International Conference on Software Engineering · doi:10.1145/3597503.3639226 · Cited by 349
Shaping program repair space with existing patches and similar code
Jiang, J., Xiong, Y., Zhang, H., Gao, Q., & Chen, X. (2018) · Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3213846.3213871 · Cited by 329
Less training, more repairing please: revisiting automated program repair via zero-shot learning
Xia, C. S., & Zhang, L. (2022) · Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering · doi:10.1145/3540250.3549101 · Cited by 231
Metadata
- Authors
- Gazzola, L., Micucci, D., & Mariani, L.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2019-01-01
- Volume
- 45
- Issue
- 1
- Pages
- 34-67
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W3208407575
- Cited by
- 327
- References
- 123
- FWCI
- 63.71
- Type
- journal article
- Language
- en
- Open access
- bronze
- Funders
- EU H2020
- ERC Consolidator (646867)
- MIUR (2015KWREMX)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.