The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
GenProg: A Generic Method for Automatic Software Repair
Abstract
This paper describes GenProg, an automated method for repairing defects in off-the-shelf, legacy programs without formal specifications, program annotations, or special coding practices. GenProg uses an extended form of genetic programming to evolve a program variant that retains required functionality but is not susceptible to a given defect, using existing test suites to encode both the defect and required functionality. Structural differencing algorithms and delta debugging reduce the difference between this variant and the original program to a minimal repair. We describe the algorithm and report experimental results of its success on 16 programs totaling 1.25 M lines of C code and 120K lines of module code, spanning eight classes of defects, in 357 seconds, on average. We analyze the generated repairs qualitatively and quantitatively to demonstrate that the process efficiently produces evolved programs that repair the defect, are not fragile input memorizations, and do not lead to serious degradation in functionality.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic Programming: On the Programming of Computers by Means of Natural Selection
Koza, J. R. (1992) · Medical Entomology and Zoology · Cited by 13,082
Introduction to Evolutionary Computing
Eiben, A. E., & Smith, J. E. (2003) · Natural Computing Series · doi:10.1007/978-3-662-05094-1 · Cited by 4,176
Denning, D. E. (1987) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1987.232894 · Cited by 3,427
An empirical study of the reliability of UNIX utilities
Miller, B. P., Fredriksen, L., & So, B. (1990) · Communications of the ACM · doi:10.1145/96267.96279 · Cited by 1,281
Simplifying and isolating failure-inducing input
Zeller, A., & Hildebrandt, R. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988498 · Cited by 1,079
CIL: Intermediate Language and Tools for Analysis and Transformation of C Programs
Necula, G. C., McPeak, S., Rahul, S. P., & Weimer, W. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45937-5_16 · Cited by 977
Self-citationAnvik, J., Hiew, L., & Murphy, G. C. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134336 · Cited by 924
Genetic Algorithms: Principles of Natural Selection Applied to Computation
Forrest, S. (1993) · Science · doi:10.1126/science.8346439 · Cited by 882
Self-citationAnomalous Payload-Based Network Intrusion Detection
Wang, K., & Stolfo, S. J. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-30143-1_11 · Cited by 842
Automatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
Self-citationHovemeyer, D., & Pugh, W. (2004) · Companion to the 19th annual ACM SIGPLAN conference on Object-oriented programming systems, languages, and applications · doi:10.1145/1028664.1028717 · Cited by 760
A systematic review of software development cost estimation studies
Jørgensen, M., & Shepperd, M. (2007) · Brunel University Research Archive (BURA) (Brunel University London) · doi:10.1109/tse.2007.3 · Cited by 742
Bugs as deviant behavior: a general approach to inferring errors in systems code
Engler, D., Chen, D. Y., Hallem, S., Chou, A., & Chelf, B. (2001) · Proceedings of the eighteenth ACM symposium on Operating systems principles · doi:10.1145/502034.502041 · Cited by 737
A Systematic Review of Software Development Cost Estimation Studies
Jorgensen, M., & Shepperd, M. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256943 · Cited by 729
Polygraph: Automatically Generating Signatures for Polymorphic Worms
Newsome, J., Karp, B., & Song, D. (2005) · 2005 IEEE Symposium on Security and Privacy (S&P'05) · doi:10.1109/sp.2005.15 · Cited by 670
The Current State and Future of Search Based Software Engineering
Harman, M. (2007) · Future of Software Engineering (FOSE '07) · doi:10.1109/fose.2007.29 · Cited by 631
Automatically Validating Temporal Safety Properties of Interfaces
Ball, T., & Rajamani, S. K. (2001) · Cited by 599
Anomaly detection of web-based attacks
Kruegel, C., & Vigna, G. (2003) · Proceedings of the 10th ACM conference on Computer and communications security · doi:10.1145/948109.948144 · Cited by 551
The Security Development Lifecycle
Howard, M. D., & Lipner, S. (2006) · Microsoft Press eBooks · Cited by 507
Bug isolation via remote program sampling
Liblit, B., Aiken, A., Zheng, A. X., & Jordan, M. I. (2003) · ACM SIGPLAN Notices · doi:10.1145/780822.781148 · Cited by 504
Building diverse computer systems
Forrest, S., Somayaji, A., & Ackley, D. H. (2002) · Proceedings. The Sixth Workshop on Hot Topics in Operating Systems (Cat. No.97TB100133) · doi:10.1109/hotos.1997.595185 · Cited by 491
Self-citationIterative context bounding for systematic testing of multithreaded programs
Musuvathi, M., & Qadeer, S. (2007) · Proceedings of the 28th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/1250734.1250785 · Cited by 483
Generating software test data by evolution
Michael, C. C., McGraw, G., & Schatz, M. A. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.988709 · Cited by 478
Fitness Distance Correlation as a Measure of Problem Difficulty for Genetic Algorithms
Jones, T., & Forrest, S. (1995) · Cited by 469
Self-citationAutomatically patching errors in deployed software
Perkins, J. H., Kim, S., Larsen, S., Amarasinghe, S., Bachrach, J., Carbin, M., Pacheco, C., Sherwood, F., Sidiroglou, S., Sullivan, G., et al. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629585 · Cited by 409
Leveraging legacy system dollars for e-business
Erlikh, L. (2000) · IT Professional · doi:10.1109/6294.846201 · Cited by 400
Yesterday, my program worked. Today, it does not. Why?
Zeller, A. (1999) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/318774.318946 · Cited by 360
Genetic Algorithms, Selection Schemes, and the Varying Effects of Noise
Miller, B. L., & Goldberg, D. E. (1996) · Evolutionary Computation · doi:10.1162/evco.1996.4.2.113 · Cited by 353
TimeAware test suite prioritization
Walcott, K. R., Soffa, M. L., Kapfhammer, G. M., & Roos, R. S. (2006) · Proceedings of the 2006 international symposium on Software testing and analysis · doi:10.1145/1146238.1146240 · Cited by 340
Human-competitive results produced by genetic programming
Koza, J. R. (2010) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-010-9112-3 · Cited by 321
From symptom to cause: localizing errors in counterexample traces
Ball, T., Naik, M., & Rajamani, S. K. (2003) · Proceedings of the 30th ACM SIGPLAN-SIGACT symposium on Principles of programming languages · doi:10.1145/604131.604140 · Cited by 294
N-variant systems: a secretless framework for security through diversity
Cox, B., Evans, D., Filipi, A., Rowanhill, J. C., Hu, W., Davidson, J. W., Knight, J. C., Nguyen‐Tuong, A., & Hiser, J. D. (2006) · Cited by 289
Automatic Patch-Based Exploit Generation is Possible: Techniques and Implications
Brumley, D., Poosankam, P., Song, D., & Zheng, J. (2008) · 2008 IEEE Symposium on Security and Privacy (sp 2008) · doi:10.1109/sp.2008.17 · Cited by 281
Automatic extraction of object-oriented component interfaces
Whaley, J., Martin, M. C., & Lam, M. S. (2002) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/566171.566212 · Cited by 261
Automatically validating temporal safety properties of interfaces
Ball, T., & Rajamani, S. K. (2001) · Lecture Notes in Computer Science · doi:10.1007/3-540-45139-0_7 · Cited by 253
Coping with an open bug repository
Anvik, J., Hiew, L., & Murphy, G. C. (2005) · Proceedings of the 2005 OOPSLA workshop on Eclipse technology eXchange - eclipse '05 · doi:10.1145/1117696.1117704 · Cited by 252
A novel co-evolutionary approach to automatic software bug fixing
Arcuri, A., & Yao, X. (2008) · 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence) · doi:10.1109/cec.2008.4630793 · Cited by 250
Seng, O., Stammel, J., & Burkhart, D. (2006) · Proceedings of the 8th annual conference on Genetic and evolutionary computation · doi:10.1145/1143997.1144315 · Cited by 246
Bug isolation via remote program sampling
Liblit, B., Aiken, A., Zheng, A. X., & Jordan, M. I. (2003) · Proceedings of the ACM SIGPLAN 2003 conference on Programming language design and implementation · doi:10.1145/781131.781148 · Cited by 241
A genetic programming approach to automated software repair
Forrest, S., Nguyen, T., Weimer, W., & Le Goues, C. (2009) · Proceedings of the 11th Annual conference on Genetic and evolutionary computation · doi:10.1145/1569901.1570031 · Cited by 236
Self-citationUsing Mutation to Automatically Suggest Fixes for Faulty Programs
Debroy, V., & Wong, W. E. (2010) · 2010 Third International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2010.66 · Cited by 226
Anomaly detection of web-based attacks
Kruegel, C., & Vigna, G. (2003) · doi:10.1145/948143.948144 · Cited by 225
Modernizing Legacy Systems: Software Technologies, Engineering Process and Business Practices
Seacord, R. C., Plakosh, D., & Lewis, G. A. (2003) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 221
Automatically documenting program changes
Buse, R. P. L., & Weimer, W. R. (2010) · Proceedings of the IEEE/ACM international conference on Automated software engineering · doi:10.1145/1858996.1859005 · Cited by 219
Self-citationSen, K. (2007) · Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering · doi:10.1145/1321631.1321746 · Cited by 194
Merlin: specification inference for explicit information flow problems
Livshits, B., Nori, A. V., Rajamani, S. K., & Banerjee, A. (2009) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/1542476.1542485 · Cited by 162
ASSURE: automatic software self-healing using rescue points
Sidiroglou, S., Laadan, O., Perez, C. A. G., Viennot, N., Nieh, J., & Keromytis, A. D. (2009) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/1508244.1508250 · Cited by 159
Yesterday, my Program Worked. Today, it Does Not. Why?
Zeller, A. (1999) · Lecture notes in computer science · doi:10.1007/3-540-48166-4_16 · Cited by 156
Protocol-Independent Adaptive Replay of Application Dialog.
Cui, W., Paxson, V., Weaver, N. C., & Katz, R. H. (2006) · Cited by 148
Staffing a software project: A constraint satisfaction and optimization-based approach
Barreto, A. S., Barros, M. D. O., & Werner, C. M. L. (2007) · Computers & Operations Research · doi:10.1016/j.cor.2007.01.010 · Cited by 147
Automatic extraction of object-oriented component interfaces
Whaley, J., Martin, M. C., & Lam, M. S. (2002) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/566172.566212 · Cited by 146
Countering Network Worms Through Automatic Patch Generation
Sidiroglou, S., & Keromytis, A. D. (2005) · IEEE Security & Privacy · doi:10.1109/msp.2005.144 · Cited by 136
Inference and enforcement of data structure consistency specifications
Demsky, B. C., Ernst, M. D., Guo, P. J., McCamant, S., Perkins, J. H., & Rinard, M. (2006) · International Symposium on Software Testing and Analysis · doi:10.1145/1146238.1146266 · Cited by 127
Weimer, W. R. (2006) · International Conference on Generative Programming and Component Engineering (GPCE) · doi:10.1145/1173706.1173734 · Cited by 123
Self-citationDIRA: Automatic Detection, Identification and Repair of Control-Hijacking Attacks.
Смирнов, А. В., & Chiueh, T. (2005) · Cited by 105
A Serial Combination of Anomaly and Misuse IDSes Applied to HTTP Traffic
Tombini, E., Debar, H., Mé, L., & Ducassé, M. (2005) · Annual Computer Security Applications Conference · doi:10.1109/csac.2004.4 · Cited by 93
Learning DFA representations of HTTP for protecting web applications
Ingham, K. L., Somayaji, A., Burge, J., et al. (2006) · Computer Networks · doi:10.1016/j.comnet.2006.09.016 · Cited by 93
Specification Mining with Few False Positives
Goues, C. L., & Weimer, W. R. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-00768-2_26 · Cited by 80
Self-citationAutomated program repair through the evolution of assembly code
Schulte, E., Forrest, S., & Weimer, W. R. (2010) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/1858996.1859059 · Cited by 73
Self-citationFinding safety errors with ACO
Alba, E., & Chicano, F. (2007) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1276958.1277171 · Cited by 72
Designing better fitness functions for automated program repair
Fast, E., Goues, C. L., Forrest, S., & Weimer, W. R. (2010) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1830483.1830654 · Cited by 61
Self-citationProblem Difficulty and Code Growth in Genetic Programming
Gustafson, S., Ekárt, A., Burke, E. K., & Kendall, G. (2004) · Genetic Programming and Evolvable Machines · doi:10.1023/b:genp.0000030194.98244.e3 · Cited by 55
Explaining abstract counterexamples
Chaki, S., Groce, A., & Strichman, O. (2004) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/1029894.1029908 · Cited by 54
Automatic extraction of object-oriented component interfaces
Whaley, J., Martin, M. C., & Lam, M. S. (2002) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/566210.566212 · Cited by 46
Advances in software engineering
Ramamoorthy, C. V., & Tsai, W. (1996) · Computer · doi:10.1109/2.539720 · Cited by 43
Vigilante: End-to-end containment of Internet worm epidemics
Costa, M., Crowcroft, J., Castro, M., Rowstron, A. I. T., Zhou, L., Zhang, L., & Barham, P. (2008) · ACM Transactions on Computer Systems · doi:10.1145/1455258.1455259 · Cited by 38
Cited by
A survey of human-in-the-loop for machine learning
Wu, X., Xiao, L., Sun, Y., Zhang, J., Ma, T., & He, L. (2022) · Future Generation Computer Systems · doi:10.1016/j.future.2022.05.014 · Cited by 800
Large language models for software engineering: survey and open problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · 2023 IEEE/ACM International Conference on Software Engineering: Future of Software Engineering (ICSE-FoSE) · doi:10.1109/icse-fose59343.2023.00008 · Cited by 650
Large Language Models for Software Engineering: Survey and Open Problems
Fan, A., Gokkaya, B., Harman, M., Lyubarskiy, M., Sengupta, S., Yoo, S., & Zhang, J. M. (2023) · arXiv · doi:10.48550/arxiv.2310.03533 · Cited by 523
Automated Program Repair in the Era of Large Pre-trained Language Models
Xia, C. S., Wei, Y., & Zhang, L. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00129 · Cited by 433
Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs
Xuan, J., Martinez, M., DeMarco, F., Clement, M., Marcote, S. L., Durieux, T., Le Berre, D., & Monperrus, M. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2560811 · Cited by 430
Metadata
- Authors
- Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2012-01
- Volume
- 38
- Issue
- 1
- Pages
- 54-72
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2145373440
- Cited by
- 1,085
- References
- 66
- FWCI
- 90.73
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.