The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Leveraging program equivalence for adaptive program repair: Models and first results
Abstract
Software bugs remain a compelling problem. Automated program repair is a promising approach for reducing cost, and many methods have recently demonstrated positive results. However, success on any particular bug is variable, as is the cost to find a repair. This paper focuses on generate-and-validate repair methods that enumerate candidate repairs and use test cases to define correct behavior. We formalize repair cost in terms of test executions, which dominate most test-based repair algorithms. Insights from this model lead to a novel deterministic repair algorithm that computes a patch quotient space with respect to an approximate semantic equivalence relation. This allows syntactic and dataflow analysis techniques to dramatically reduce the repair search space. Generate-and-validate program repair is shown to be a dual of mutation testing, suggesting several possible cross-fertilizations. Evaluating on 105 real-world bugs in programs totaling 5MLOC and involving 10,000 tests, our new algorithm requires an order-of-magnitude fewer test evaluations than the previous state-of-the-art and is over three times more efficient monetarily.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hints on Test Data Selection: Help for the Practicing Programmer
DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978) · Computer · doi:10.1109/c-m.1978.218136 · Cited by 2,081
An Analysis and Survey of the Development of Mutation Testing
Jia, Y., & Harman, M. (2011) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.62 · Cited by 1,745
Empirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,238
GenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085
Self-citationCIL: Intermediate Language and Tools for Analysis and Transformation of C Programs
Necula, G. C., McPeak, S., Rahul, S. P., & Weimer, W. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45937-5_16 · Cited by 977
Self-citationAnvik, J., Hiew, L., & Murphy, G. C. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134336 · Cited by 924
Automatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
Self-citationWeak Mutation Testing and Completeness of Test Sets
Howden, W. E. (1982) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1982.235571 · Cited by 477
Automatic patch generation learned from human-written patches
Kim, D., Nam, J., Song, J., & Kim, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606626 · Cited by 449
Automatic patch generation learned from human-written patches
Kim, D., Nam, J., Song, J., & Kim, S. (2013) · Cited by 438
Automatically patching errors in deployed software
Perkins, J. H., Kim, S., Larsen, S., Amarasinghe, S., Bachrach, J., Carbin, M., Pacheco, C., Sherwood, F., Sidiroglou, S., Sullivan, G., et al. (2009) · Proceedings of the ACM SIGOPS 22nd symposium on Operating systems principles · doi:10.1145/1629575.1629585 · Cited by 409
SemFix: program repair via semantic analysis
Nguyen, H. D. T., Qi, D., Roychoudhury, A., & Chandra, S. (2013) · doi:10.5555/2486788.2486890 · Cited by 398
SemFix: Program repair via semantic analysis
Nguyen, H. D. T., Qi, D., Roychoudhury, A., & Chandra, S. (2013) · 2013 35th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2013.6606623 · Cited by 395
Chianti: a tool for change impact analysis of java programs
Ren, X., Shah, F., Tip, F., Ryder, B. G., & Chesley, O. (2004) · Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications · doi:10.1145/1028976.1029012 · Cited by 382
Investigations of the software testing coupling effect
Offutt, A. J. (1992) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/125489.125473 · Cited by 371
A systematic study of automated program repair: Fixing 55 out of 105 bugs for $8 each
Le Goues, C., Dewey-Vogt, M., Forrest, S., & Weimer, W. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227211 · Cited by 326
Self-citationAutomatically detecting equivalent mutants and infeasible paths
Offutt, A. J., & Pan, J. (1997) · Software Testing Verification and Reliability · Cited by 296
Software fault injection: inoculating programs against errors
Voas, J. M., & McGraw, G. E. (1997) · John Wiley & Sons, Inc. eBooks · Cited by 275
Mutation analysis of program test data
Budd, T. A. (1980) · Cited by 236
A genetic programming approach to automated software repair
Forrest, S., Nguyen, T., Weimer, W., & Le Goues, C. (2009) · Proceedings of the 11th Annual conference on Genetic and evolutionary computation · doi:10.1145/1569901.1570031 · Cited by 236
Self-citationAutomated fixing of programs with contracts
Wei, Y., Pei, Y., Furia, C. A., Silva, L. S., Buchholz, S., Meyer, B., & Zeller, A. (2010) · Proceedings of the 19th international symposium on Software testing and analysis · doi:10.1145/1831708.1831716 · Cited by 235
Using Mutation to Automatically Suggest Fixes for Faulty Programs
Debroy, V., & Wong, W. E. (2010) · 2010 Third International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2010.66 · Cited by 226
Using program slicing to assist in the detection of equivalent mutants
Hierons, R. M., Harman, M., & Danicic, S. (1999) · Software Testing Verification and Reliability · Cited by 218
Dynamic test generation to find integer bugs in x86 binary linux programs
Molnár, D., Li, X. C., & Wagner, D. A. (2009) · Cited by 198
Constructing Subtle Faults Using Higher Order Mutation Testing
Jia, Y., & Harman, M. (2008) · 2008 Eighth IEEE International Working Conference on Source Code Analysis and Manipulation · doi:10.1109/scam.2008.36 · Cited by 195
Mutation analysis using mutant schemata
Untch, R. H., Offutt, A. J., & Harrold, M. J. (1993) · Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis · doi:10.1145/154183.154265 · Cited by 187
Sufficient mutation operators for measuring test effectiveness
Siami Namin, A., Andrews, J. H., & Murdoch, D. J. (2008) · Proceedings of the 13th international conference on Software engineering - ICSE '08 · doi:10.1145/1368088.1368136 · Cited by 178
Performance, effectiveness, and reliability issues in software testing
Mathur, A. P. (2002) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.1991.170248 · Cited by 168
Using compiler optimization techniques to detect equivalent mutants
Offutt, A. J., & Craft, W. M. (1994) · Software Testing, Verification and Reliability · doi:10.1002/stvr.4370040303 · Cited by 167
Automated atomicity-violation fixing
Jin, G., Song, L., Zhang, W., Lu, S., & Liblit, B. (2011) · ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI) · doi:10.1145/1993498.1993544 · Cited by 151
An empirical comparison of data flow and mutation‐based test adequacy criteria
Mathur, A. P., & Wong, W. E. (1994) · Software Testing Verification and Reliability · doi:10.1002/stvr.4370040104 · Cited by 137
Countering Network Worms Through Automatic Patch Generation
Sidiroglou, S., & Keromytis, A. D. (2005) · IEEE Security & Privacy · doi:10.1109/msp.2005.144 · Cited by 136
Automated atomicity-violation fixing
Jin, G., Song, L., Zhang, W., Lu, S., & Liblit, B. (2011) · ACM SIGPLAN Notices · doi:10.1145/1993316.1993544 · Cited by 135
Inference and enforcement of data structure consistency specifications
Demsky, B. C., Ernst, M. D., Guo, P. J., McCamant, S., Perkins, J. H., & Rinard, M. (2006) · International Symposium on Software Testing and Analysis · doi:10.1145/1146238.1146266 · Cited by 127
On the automation of fixing software bugs
Arcuri, A. (2008) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/1370175.1370223 · Cited by 125
Weimer, W. R. (2006) · International Conference on Generative Programming and Component Engineering (GPCE) · doi:10.1145/1173706.1173734 · Cited by 123
Self-citationA human study of patch maintainability
Fry, Z. P., Landau, B., & Weimer, W. R. (2012) · International Symposium on Software Testing and Analysis · doi:10.1145/2338965.2336775 · Cited by 122
Self-citationAutomatic recovery from runtime failures
Carzaniga, A., Gorla, A., Mattavelli, A., Perino, N., & Pezzè, M. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606624 · Cited by 116
Heuristics for Determining Equivalence of Program Mutations.
Baldwin, D., & Sayward, F. G. (1979) · Defense Technical Information Center (DTIC) · doi:10.21236/ada071795 · Cited by 114
Acree, J. A. T. (1980) · Cited by 111
The coupling effect: fact or fiction
Offutt, A. J. (1989) · doi:10.1145/75308.75324 · Cited by 110
DIRA: Automatic Detection, Identification and Repair of Control-Hijacking Attacks.
Смирнов, А. В., & Chiueh, T. (2005) · Cited by 105
Using automated program repair for evaluating the effectiveness of fault localization techniques
Qi, Y., Mao, X., Lei, Y., & Wang, C. (2013) · International Symposium on Software Testing and Analysis · doi:10.1145/2483760.2483785 · Cited by 99
Software mutational robustness
Schulte, E., Fry, Z. P., Fast, E., Weimer, W. R., & Forrest, S. (2013) · Genetic Programming and Evolvable Machines · doi:10.1007/s10710-013-9195-8 · Cited by 96
Self-citationFlight of the FINCH Through the Java Wilderness
Orlov, M., & Sipper, M. (2011) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2010.2052622 · Cited by 94
Automatic recovery from runtime failures
Carzaniga, A., Gorla, A., Mattavelli, A., Perino, N., & Pezzè, M. (2013) · doi:10.5555/2486788.2486891 · Cited by 81
Representations and operators for improving evolutionary software repair
Goues, C. L., Weimer, W. R., & Forrest, S. (2012) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/2330163.2330296 · Cited by 74
Self-citationChianti: a tool for change impact analysis of java programs
Ren, X., Shah, F., Tip, F., Ryder, B. G., & Chesley, O. (2004) · ACM SIGPLAN Notices · doi:10.1145/1035292.1029012 · Cited by 67
Estimation and enhancement of real-time software reliability through mutation analysis
Geist, R., Offutt, A. J., & Harris, F. C. (1992) · IEEE Transactions on Computers · doi:10.1109/12.142681 · Cited by 66
Designing better fitness functions for automated program repair
Fast, E., Goues, C. L., Forrest, S., & Weimer, W. R. (2010) · Genetic and Evolutionary Computation Conference (GECCO) · doi:10.1145/1830483.1830654 · Cited by 61
Self-citationDetecting and escaping infinite loops with jolt
Carbin, M., Misailovíc, S., Kling, M., & Rinard, M. (2011) · doi:10.5555/2032497.2032537 · Cited by 58
Program transformations to fix C integers
Coker, Z., & Hafiz, M. (2013) · doi:10.5555/2486788.2486892 · Cited by 52
The coupling effect: fact or fiction
Offutt, A. J. (1989) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/75309.75324 · Cited by 44
Detecting and Escaping Infinite Loops with Jolt
Carbin, M., Misailovíc, S., Kling, M., & Rinard, M. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-22655-7_28 · Cited by 38
Program transformations to fix C integers
Coker, Z., & Hafiz, M. (2013) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2013.6606625 · Cited by 38
Cited by
Angelix: scalable multiline program patch synthesis via symbolic analysis
Mechtaev, S., Yi, J., & Roychoudhury, A. (2016) · Proceedings of the 38th International Conference on Software Engineering · doi:10.1145/2884781.2884807 · Cited by 515
Automatic patch generation by learning correct code
Long, F., & Rinard, M. (2016) · Proceedings of the 43rd Annual ACM SIGPLAN-SIGACT Symposium on Principles of Programming Languages · doi:10.1145/2837614.2837617 · Cited by 481
Nopol: Automatic Repair of Conditional Statement Bugs in Java Programs
Xuan, J., Martinez, M., DeMarco, F., Clement, M., Marcote, S. L., Durieux, T., Le Berre, D., & Monperrus, M. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2560811 · Cited by 430
Mutation Testing Advances: An Analysis and Survey
(2019) · Advances in Computers · doi:10.1016/bs.adcom.2018.03.015 · Cited by 425
An analysis of patch plausibility and correctness for generate-and-validate patch generation systems
Qi, Z., Long, F., Achour, S., & Rinard, M. (2015) · Proceedings of the 2015 International Symposium on Software Testing and Analysis · doi:10.1145/2771783.2771791 · Cited by 420
Metadata
- Authors
- Weimer, W., Fry, Z. P., & Forrest, S.
- Venue
- 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE)
- Publisher
- IEEE
- Published
- 2013-11
- Pages
- 356-366
- OpenAlex
- W1977696633
- Cited by
- 266
- References
- 55
- FWCI
- 10.11
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.