Shaping program repair space with existing patches and similar code
The DOI matches its Crossref record; 71 of the 72 references it cites were found in a registry or an index.
Abstract
Automated program repair (APR) has great potential to reduce bug-fixing effort and many approaches have been proposed in recent years. APRs are often treated as a search problem where the search space consists of all the possible patches and the goal is to identify the correct patch in the space. Many techniques take a data-driven approach and analyze data sources such as existing patches and similar source code to help identify the correct patch. However, while existing patches and similar code provide complementary information, existing techniques analyze only a single source and cannot be easily extended to analyze both.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Java Language Specification
Gosling, J., Joy, B., & Steele, G. L. (1996) · Cited by 3,924
CCFinder: a multilinguistic token-based code clone detection system for large scale source code
Kamiya, T., Kusumoto, S., & Inoue, K. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1019480 · Cited by 1,711 · cited 1×
“Our approach depends on the search of similar code in a project, which is related to the work on code clone detection [24, 28, 32, 55].”
MethodSalton, G. (1988) · Cited by 1,587
Defects4J: a database of existing faults to enable controlled testing studies for Java programs
Just, R., Jalali, D., & Ernst, M. D. (2014) · Proceedings of the 2014 International Symposium on Software Testing and Analysis · doi:10.1145/2610384.2628055 · Cited by 1,447 · cited 3×
“1 Experiment Setup Weevaluated SimFix onDefects4J [21] v1.”
BackgroundMethodInfluentialGenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085 · cited 10×
“Different from most existing approaches [24, 30, 48, 49, 59, 71] that reuse similar code at the statement granularity, our approach utilizes a fine-grained differencing algorithm to reuse similar code at the AST subtree granularity.”
BackgroundMethodResultInfluentialDECKARD: Scalable and Accurate Tree-Based Detection of Code Clones
Jiang, L., Misherghi, G., Su, Z., & Glondu, S. (2007) · 29th International Conference on Software Engineering (ICSE'07) · doi:10.1109/icse.2007.30 · Cited by 1,039 · cited 2×
“Following DECKARD [20], we extract a vector from each code snippet, where each element in the vector represents a feature of AST nodes.”
MethodAutomatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761 · cited 7×
“We adopted the experimental results for jGenProg (jGP), jKali and Nopol reported by Martinez et al. [38].”
BackgroundInfluentialCP-Miner: finding copy-paste and related bugs in large-scale software code
Li, Z., Lu, S., Myagmar, S., & Zhou, Y. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.28 · Cited by 610 · cited 2×
“Consistent modifications (changes) [17, 32] are those modifications that require the same changes to a variable at different locations at the same time.”
BackgroundMethodChange Distilling:Tree Differencing for Fine-Grained Source Code Change Extraction
Fluri, B., Wursch, M., PInzger, M., & Gall, H. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70731 · Cited by 607 · cited 1×
“ChangeDistiller [10] is a widely-used approach for source code transformation at AST level.”
MethodAn Analysis for Unreplicated Fractional Factorials
Box, G. E. P., & Meyer, R. D. (1986) · Technometrics · doi:10.1080/00401706.1986.10488093 · Cited by 576 · cited 1×
“In our experiment, we set k to a value where the search space can cover 80% of the patches according to the Pareto principle [7].”
Method
Research works printed but not linked: 9
- Divya Gopinath , Muhammad Zubair Malik, and Sarfraz Khurshid . 2011 . Divya Gopinath, Muhammad Zubair Malik, and Sarfraz Khurshid. 2011.
- Xuan-Bach D. Le , Duc-Hiep Chu , David Lo , Claire Le Goues, and Willem Visser . 2017 . Xuan-Bach D. Le, Duc-Hiep Chu, David Lo, Claire Le Goues, and Willem Visser. 2017.
- Na Meng , Miryung Kim , and Kathryn S . McKinley . 2011 . Na Meng, Miryung Kim, and Kathryn S. McKinley. 2011.
- Sydit: Creating and Applying a Program Transformation from an Example (ESEC/FSE ’11). 440–443. Sydit: Creating and Applying a Program Transformation from an Example (ESEC/FSE ’11). 440–443.
- 10 .1145/2661694.2661695 10.1145/2661694.2661695 · DOI
- Practical Analysis for Refactoring . Technical Report. Champaign, IL, USA . Practical Analysis for Refactoring. Technical Report. Champaign, IL, USA.
- 10.1109/ICSE.2017.44 · DOI
- Gerald Salton (Ed.). 1988. Gerald Salton (Ed.). 1988.
- Westley Weimer , ThanhVu Nguyen , Claire Le Goues, and Stephanie Forrest . 2009 . Westley Weimer, ThanhVu Nguyen, Claire Le Goues, and Stephanie Forrest. 2009.
Cited by
Items 101–200 of 332
Hybrid Automated Program Repair by Combining Large Language Models and Program Analysis
Li, F., Jiang, J., Sun, J., & Zhang, H. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3715004 · Cited by 97
“They employed a wide range of techniques, including predefined repair templates [6], [11], [12], [16]–[18], heuristic rules [1], [7]–[10], [13], [14], program synthesis [2]–[5] and deep-learning [21]–[27].”
InfluentialSelf-citationTowards Understanding the Characteristics of Code Generation Errors Made by Large Language Models
Wang, Z., Zhou, Z., Song, D., Huang, Y., Chen, S., Ma, L., & Zhang, T. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00180 · Cited by 120
Contract-Based Program Repair Without The Contracts: An Extended Study
Chen, L., Pei, Y., & Furia, C. A. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2970009 · Cited by 27
“Consider the 23 bugs that only ACS (11 bugs) or SimFix (12 bugs) can fix: 9 require inserting statements that throw appropriate exceptions, which is something only ACS can do at the moment; 4 require changing the code at two locations simultaneously, which is something very few tools other than SimFix are capable of;…”
BackgroundMethodInfluentialPyTER: effective program repair for Python type errors
Oh, W.-S., & Oh, H. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3549130 · Cited by 22
“These techniques are further classified into generate-and-validate [29, 33, 40, 41, 57] and semantic-based approaches [34, 35, 42, 43, 47, 61].”
BackgroundMethodSo, S., & Oh, H. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616341 · Cited by 28
“In particular, our work is closely related to generate-and-validate approaches [29, 32, 38, 39, 56], which iteratively generate candidate patches using search algorithms until a solution program is found.”
MethodZhang, L., Li, K., Sun, K., Wu, D., Liu, Y., Tian, H., & Liu, Y. (2025) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2025.3590108 · Cited by 71
“Numerous works have focused on repairing bugs or vulnerabilities in traditional software [42], [87], [88], [89], [90], [91], [92], [93], [94], [95], [96], [97], [98], especially in C [91], [92], [93], Java [90], [94], and PHP [87].”
On the Impact of Flaky Tests in Automated Program Repair
Qin, Y., Wang, S., Liu, K., Mao, X., & Bissyandé, T. F. (2021) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner50967.2021.00035 · Cited by 27
“However, state-of-the-art APR tools such as SimFix [5] and CapGen [6] tend to achieve poor performances on these bugs.”
BackgroundMethodGuo, H., Chen, Y., Chen, X., Huang, Y., & Zheng, Z. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3637229 · Cited by 33
“In traditional programming languages (e.g., Java, C++), automatic repair approaches use different techniques [16] such as heuristic search [18, 35, 36], defined repair patterns [3, 24, 25], machine learning [26, 62, 71, 81], and so on.”
MethodSelf-citationOne Size Does Not Fit All: Multi-granularity Patch Generation for Better Automated Program Repair
Lin, B., Wang, S., Wen, M., Chen, L., & Mao, X. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3680381 · Cited by 40
“…independent field and existing APR techniques employ off-the-shelf fault localization tools in the repair pipeline, we do not discuss the fault localization below and reuse the GZoltar API [5] and Ochiai similarity coefficient [1], which are commonly used in existing APR tools [26, 35, 55, 59, 64].”
InfluentialEnhancing OSS Patch Backporting with Semantics
Yang, S., Xiao, Y., Xu, Z., Sun, C., Ji, C., & Zhang, Y. (2023) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3576915.3623188 · Cited by 19
E-APR: Mapping the effectiveness of automated program repair techniques
Aleti, A., & Martínez, M. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-09989-x · Cited by 32
Interactive Patch Filtering as Debugging Aid
Liang, J., Ji, R., Jiang, J., Zhou, S., Lou, Y., Xiong, Y., & Huang, G. (2021) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme52107.2021.00028 · Cited by 27
Self-citationBetter Code Search and Reuse for Better Program Repair
Qi, X., & Reiss, S. P. (2019) · IEEE/ACM International Workshop on Genetic Improvement (GI) · doi:10.1109/gi.2019.00012 · Cited by 22
“sharpFix is also related to SimFix [27] which leverages similar code to produce patches.”
BackgroundExperience Report: How Effective is Automated Program Repair for Industrial Software?
Noda, K., Nemoto, Y., Hotta, K., Hideo, T., & Kikuchi, S. (2020) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner48275.2020.9054829 · Cited by 19
“, machine learningbased [10], similarity-based [15], [16], etc.”
BackgroundEvaluating and Improving Unified Debugging
Benton, S., Li, X., Lou, Y., & Zhang, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3125203 · Cited by 20
“Depending on how the patches are generated, APR [21], [27], [45], [51] can be categorized into the following categories [58], [77]: (1) heuristic-based APR, which investigates possible code modifications for patching by iterating a search space, e.”
BackgroundMethodInfluentialLeveraging Large Language Model for Automatic Patch Correctness Assessment
Zhou, X., Xu, B., Kim, K., Han, D., Nguyen, H. H., Le-Cong, T., He, J., Le, X.-B. D., & Lo, D. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3452252 · Cited by 43
“A UTOMATED Program Repair (APR) has gained increasing attention and diverse APR tools have been proposed [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], [11], [12], [13].”
BackgroundTips: towards automating patch suggestion for vulnerable smart contracts
Chen, Q., Zhou, T., Liu, K., Li, L., Ge, C., Liu, Z., Klein, J., & Bissyandé, T. F. (2023) · Automated Software Engineering · doi:10.1007/s10515-023-00392-y · Cited by 18
“To address vulnerabilities in smart contracts, various approaches have been proposed in the literature (Luu et al. 2016; Liu et al. 2018b; Jiang et al. 2018a; Li et al. 2019; Gao et al. 2020; Brent et al. 2020).”
BackgroundMethodInfluentialAutomated Program Repair, What Is It Good For? Not Absolutely Nothing!
Eladawy, H. M., Goues, C. L., & Brun, Y. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639095 · Cited by 40
“GenProg is one of the early examples of such an APR technique [37, 81], with many more recent advances since [18, 25, 62, 76, 84].”
BackgroundMethodInfluentialREEF: A Framework for Collecting Real-World Vulnerabilities and Fixes
Wang, C., Li, Z., Pena, Y., Gao, S., Chen, S., Wang, S., Gao, C., & Lyu, M. R.-T. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00199 · Cited by 33
“Various techniques have been developed within the APR domain, including template-based [32], [33], search-based [34], [35], constraint-based [36], [37], and learning-based approaches [10]–[19].”
MethodExploring Experiences with Automated Program Repair in Practice
Meem, F. N., Smith, J., & Johnson, B. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639182 · Cited by 25
Wang, S., Wen, M., Mao, X., & Yang, D. (2019) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3319008.3319349 · Cited by 18
“SimFix is one of the latest search-based APR tools and has been evaluated on the non-Mockito projects in Defects4J [29].”
BackgroundMethodInfluentialAligning the Objective of LLM-Based Program Repair
Xu, J., Fu, Y., Tan, S. H., & He, P. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00169 · Cited by 69
Context-based cluster fault localization
Yu, J., Lei, Y., Xie, H., Fu, L., & Liu, C. (2022) · IEEE International Conference on Program Comprehension (ICPC) · doi:10.1145/3524610.3527891 · Cited by 16
“A user study [31] of evaluating the usefulness of FL techniques in assisting developers recommended using [17] and TBar [24], set clear time limitations, the improvement of MFR metric could also help the APR techniques that relay on the suspicious rank list and have limited time for each bug during…”
MethodEvolving Paradigms in Automated Program Repair: Taxonomy, Challenges, and Opportunities
Huang, K., Xu, Z., Yang, S., Sun, H., Li, X., Yan, Z., & Zhang, Y. (2024) · ACM Computing Surveys · doi:10.1145/3696450 · Cited by 111
Restore: Retrospective Fault Localization Enhancing Automated Program Repair
Xu, T., Chen, L., Pei, Y., Zhang, T. Y., Pan, M., & Furia, C. A. (2020) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2020.2987862 · Cited by 20
Speeding up constraint-based program repair using a search-based technique
Yi, J., & Ismayilzada, E. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106865 · Cited by 16
“As reported in [3], state-of-the-art G&V tools such as SimFix [4] and TBar [5] repeatedly apply hundreds to thousands of patch candidates before being able to find a patch.”
BackgroundInfluential Global and Local Contexts Guided Trace Representation for Fault Localization
Zhang, Z., Lei, Y., Su, T., Yan, M. L., Mao, X., & Yu, Y. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3576043 · Cited by 17
“Being the first step, fault localization provides a suspicious rank list of statements for APR. Specifically, the APR techniques generate patches in the suspicious rank list from top to down and many APR techniques [12, 27, 62] set clear time limitation.”
NPEX: repairing Java null pointer exceptions without tests
Lee, J., Hong, S., & Oh, H. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510186 · Cited by 29
“General-purpose approaches [21, 24, 26, 27, 29, 37, 38, 43, 44, 48, 53, 59, 60, 66] are applicable to any kinds of bugs, where most techniques rely on test cases to validate patches.”
BackgroundMethodInfluentialAccelerating Patch Validation for Program Repair With Interception-Based Execution Scheduling
Xiao, Y.-A., Yang, C., Wang, B., & Xiong, Y. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3359969 · Cited by 19
“• SimFix [70], a heuristic-based tool fixing 33 bugs.”
MethodSelf-citationAsad, M., Ganguly, K. K., & Sakib, K. M. (2019) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme.2019.00050 · Cited by 21
“To find top fixing elements syntactically similar to the faulty code, SimFix uses 3 metrics - structure, variable name and method name similarities [3].”
BackgroundMethodInfluentialLearning to Synthesize Programs as Interpretable and Generalizable PoliciesPreprint
Trivedi, D., Zhang, J. M., Sun, S.-H., & Lim, J. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.13643 · Cited by 64
“[107] Jiajun Jiang, Yingfei Xiong, Hongyu Zhang, Qing Gao, and Xiangqun Chen.”
BackgroundExploring Parameter-Efficient Fine-Tuning of Large Language Model on Automated Program Repair
Li, G., Zhi, C., Chen, J., Han, J., & Deng, S. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695066 · Cited by 46
“Based on existing studies [4, 18, 35, 57, 69], traditional APR techniques include search-based [19, 28], constraint-based [44, 67] and template-based [27, 34], which require experts to provide prior knowledge manually.”
Advancements in automated program repair: a comprehensive review
Dikici, S., & Bilgin, T. T. (2025) · Knowledge and Information Systems · doi:10.1007/s10115-025-02383-9 · Cited by 39
Liu, K., Wang, S., Koyuncu, A., Kim, K., Bissyandé, T. F., Kim, D., Wu, P., Klein, J., Mao, X., & Traon, Y. L. (2020) · Open Repository and Bibliography (University of Luxembourg) · doi:10.48550/arxiv.2008.00914 · Cited by 15
“Note that early versions of this tool were widely used in the APR community [15, 38, 57, 63].”
BackgroundMethodInfluentialEvaluating the usage of fault localization in automated program repair: an empirical study
Yang, D., Qi, Y., Mao, X., & Lei, Y. (2020) · Frontiers of Computer Science · doi:10.1007/s11704-020-9263-1 · Cited by 18
“We implement the two algorithms into 4 state-of-the-art repair approaches (i.e., Nopol [10], jMutRepair [18], jKali [18], SimFix [6]).”
BackgroundMethodInfluentialReliable Fix Patterns Inferred from Static Checkers for Automated Program Repair
Liu, K., Zhang, J., Li, L., Koyuncu, A., Kim, D., Ge, C., Liu, Z., Klein, J., & Bissyandé, T. F. (2023) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3579637 · Cited by 19
“The second one focuses on improving the patch generation process to reduce the probability of generating nonsensical patches [16, 21, 68].”
BackgroundMethodInfluentialAutomatic Repair of Quantum Programs via Unitary Operation
Li, Y., Pei, H., Huang, L., Yin, B., & Cai, K.-Y. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3664604 · Cited by 16
“With the development of benchmarks for APR (such as Defects4J [29] for Java programs), several studies like SimFix [27], TBar [32], and Recorder [64] have utilized the previous data or patterns to assist in repairing the current programs.”
Nadim, M., Hassan, M. M., Mandal, A. K., & Roy, C. K. (2025) · IEEE/ACM International Workshop on Quantum Software Engineering (Q-SE) · doi:10.1109/q-se66736.2025.00012 · Cited by 27
Automated repair of resource leaks in Android applications
Bhatt, B., & Furia, C. A. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111417 · Cited by 13
Wang, X., Yu, H., Meng, X., Cao, H., Zhang, H., Sun, H., Liu, X., & Hu, C. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3654441 · Cited by 18
“However, since test cases are limited to reflect the real code semantics to some extent, plausible patches cannot be regarded as semantically correct patches [20, 42, 90].”
InfluentialSelf-citationFine-grained, accurate and scalable source differencing
Falleri, J., & Martínez, M. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3639148 · Cited by 30
Investigating large language models capabilities for automatic code repair in Python
Omari, S., Basnet, K., & Wardat, M. (2024) · Cluster Computing · doi:10.1007/s10586-024-04490-8 · Cited by 15
“Automatic Program Repair (APR) techniques include search-based, constraint-based, statistical-based, transformation-based, etc. to automatically identify and fix software bugs [29–31].”
Simulating the Effect of Test Flakiness on Fault Localization Effectiveness
Vancsics, B., Gergely, T., & Beszédes, Á. (2020) · doi:10.1109/vst50071.2020.9051636 · Cited by 14
“The successfulness of program repair is hence dependent on the efficiency of fault localization [1], [2].”
BackgroundZhou, C., Li, B., Sun, X., & Bo, L. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-10010-8 · Cited by 12
Generating Concise Patches for Newly Released Programming Assignments
Li, L., Liu, H., Li, K., Jiang, Y., & Sun, R. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3153522 · Cited by 17
“This result differs from reported studies in traditional program repair [25] on the widely used Defects4J benchmark [37].”
ResultEffective Isolation of Fault-Correlated Variables via Statistical and Mutation Analysis
Wen, M., Xie, Z., Luo, K., Chen, X., Yang, Y., & Jin, H. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3209590 · Cited by 13
“include PraPR [35], TBar [56] and SimFix [57] in our experiment.”
BackgroundInfluentialSelf-citationT5APR: Empowering automated program repair across languages through checkpoint ensemble
Gharibi, R., Sadreddini, M. H., & Fakhrahmad, S. M. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112083 · Cited by 20
Patch Correctness Assessment: A Survey
Fei, Z., Ge, J., Li, C., Wang, T., Li, Y., Zhang, H., Huang, L., & Luo, B. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3702972 · Cited by 25
Self-citationProgram Repair With Repeated Learning
Chen, L., Pei, Y., Pan, M., Zhang, T. Y., Wang, Q., & Furia, C. A. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3164662 · Cited by 18
“To demonstrate the generality of the L IANA technique, we also implemented it atop the S IM-F IX APR technique [26].”
BackgroundMethodInfluentialA Large-Scale Empirical Review of Patch Correctness Checking Approaches
Yang, J., Wang, Y., Lou, Y., Wen, M., & Zhang, L. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616331 · Cited by 38
Boosting automated program repair with bug-inducing commits
Wen, M., Liu, Y., & Cheung, S.-C. (2020) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1145/3377816.3381743 · Cited by 11
“Among them, 8 bugs have never been reported to be repaired by the state-of-the-art APR techniques [1, 3, 11, 14, 17].”
BackgroundIs the Ground Truth Really Accurate? Dataset Purification for Automated Program Repair
Yang, D., Lei, Y., Mao, X., Lo, D., Xie, H., & Yan, M. L. (2021) · IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER) · doi:10.1109/saner50967.2021.00018 · Cited by 15
“For SimFix [11], the test case purification it used can help it purify a single failing test case into multiple failing cases, which can then be used for fixing the bug chunk by chunk (e.g., Math 98).”
MethodContext-based Transfer Learning for Structuring Fault Localization and Program Repair Automation
Zhang, L., Guo, S., Guo, Y., Li, H., Chai, Y., Chen, R., Li, X., & Jiang, H. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3705302 · Cited by 12
Rango: Adaptive Retrieval-Augmented Proving for Automated Software Verification
Thompson, K., Saavedra, N., Carrott, P., Fisher, K. D., Sanchez-Stern, A., Brun, Y., Ferreira, J. F., Lerner, S., & First, E. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse55347.2025.00161 · Cited by 56
“Automated techniques can similarly improve program quality [3], [39], [46], [51], [57], [86], [96], and can also help developers debug manually [21], but still do not guarantee correctness, and, in fact, often introduce new bugs [58], [76].”
Towards boosting patch execution on-the-fly
Benton, S., Xie, Y., Lu, L., Zhang, M., Li, X., & Zhang, L. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510117 · Cited by 10
“Such existing techniques primarily utilize static or dynamic information to statically prioritize patches before the patch validation [8, 23, 26], e.”
MethodInfluentialPractical Program Repair via Preference-based Ensemble Strategy
Zhong, W., Li, C., Liu, K., Xu, T., Ge, J., Bissyandé, T. F., Luo, B., & Ng, V. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3623310 · Cited by 20
“Those systems cover 4 types of APR tools: 9 are heuristic-based (jGenProg [28], GenProg-A [52], RSRepair-A [52], ARJA [52], SimFix [14], jKali [28], Kali-A [52], jMutRepair [28], TransplantFix [50]), 4 are constraint-based (Nopol [49], ACS [48], Cardumen [29], DynaMoth [10]), 4 are template-based (kPAR [20], AVATAR [2…”
MethodInfluentialExpressAPR: Efficient Patch Validation for Java Automated Program Repair Systems
Xiao, Y.-A., Yang, C., Wang, B., & Xiong, Y. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00012 · Cited by 15
“For example, recent studies [3]–[5] set a 5-hour timeout for each bug, which is unaffordable for many users.”
BackgroundMethodSelf-citationEvaluating the Strategies of Statement Selection in Automated Program Repair
Yang, D., Qi, Y., & Mao, X. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-04272-1_3 · Cited by 13
Learning the Relation Between Code Features and Code Transforms With Structured Prediction
Yu, Z., Martínez, M., Chen, Z., Bissyandé, T. F., & Monperrus, M. (2023) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3275380 · Cited by 17
“[111] combine the search space from similar code with search space obtained by abundant existing patches to better guide program repair.”
BackgroundAnalyzing the Context of Bug-Fixing Changes in the OpenStack Cloud Computing Platform
Cotroneo, D., Simone, L. D., Iannillo, A. K., Natella, R., Rosiello, S., & Bidokhti, N. (2019) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2019.00041 · Cited by 10
Precfix: large-scale patch recommendation by mining defect-patch pairs
Zhang, X., Zhu, C., Li, Y., Guo, J., Liu, L., & Gu, H. (2020) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1145/3377813.3381356 · Cited by 13
“For example, recent studies proposed approaches based on clone detection [36], patch mining [17], information retrieval [59], and machine learning [6, 26] for fault localization and repair, which naturally require a large amount of labeled data.”
BackgroundIdentifying Incorrect Patches in Program Repair Based on Meaning of Source Code
Phung, Q.-N., Kim, M., & Lee, E. (2022) · IEEE Access · doi:10.1109/access.2022.3145983 · Cited by 15
“Other approaches use additional information such as anti-patterns [18], program invariant [19], human-written patches [20], or static features of code [21]–[23] to heuristically assess patches correctness.”
MethodYang, C. (2021) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3468264.3473496 · Cited by 10
“Redundancy-based APR techniques [1, 15] (such as GenProg [12], CapGen [21], SCRepair [5], CRSearcher [19], ssFix [22], SimFix [7] and Refactory [4]) are one of the most important categories in this field and have achieved promising results [6, 7, 22].”
InfluentialLanguage models can prioritize patches for practical program patching
Kang, S., & Yoo, S. (2022) · IEEE/ACM International Workshop on Automated Program Repair (APR) · doi:10.1145/3524459.3527343 · Cited by 16
“SimFix on Closure 57.”
BackgroundMethodInfluentialToward Improving the Robustness of Deep Learning Models via Model Transformation
Zhang, Y., Wang, Z., Jiang, J., You, H., & Chen, J. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556920 · Cited by 13
Self-citationLLM-enhanced evolutionary test generation for untyped languages
Yang, R., Xu, X., & Wang, R. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00496-7 · Cited by 18
“For example, SimFix (Jiang et al. 2018) generates an abstract search space by analyzing existing patches, then compares the differences with similar code to obtain a specific search space, ultimately performing a search in the intersection of these two spaces to generate repair patches.”
Yang, R., Xu, X., & Wang, R. (2025) · Journal of Computer Languages · doi:10.1016/j.cola.2025.101348 · Cited by 7
Wang, B., Deng, M., Chen, M., Lin, Y., Zhou, J., & Zhang, J. M. (2025) · Automated Software Engineering · doi:10.1007/s10515-025-00549-x · Cited by 13
“…2019; Zeng et al. 2022; Meng et al. 2022; Yang et al. 2024 ) and APR (Xin and Reiss 2017; Xiong et al. 2017 ; Xin and Reiss 2017; Wen et al. 2018 ; Jiang et al. 2018; Ye et al. 2022a; Xiao et al. 2024; Xiong and Wang 2022; Ye et al. 2022b; Zhu et al. 2023; Wang et al. 2024; Xin et al. 2024 ; Xia…”
Code-aware fault localization with pre-training and interpretable machine learning
Zhang, Z., Li, Y., Yang, S., Zhang, Z., & Lei, Y. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121689 · Cited by 11
From Leaks to Fixes: Automated Repairs for Resource Leak Warnings
Utture, A., & Palsberg, J. (2023) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3611643.3616267 · Cited by 13
“Since there are currently no specialized tools for resource-leak fixing, one could try using general-purpose repair tools [8, 15, 28, 29, 33–35, 39, 40, 45, 46, 49, 51, 62, 65, 67], which work on a wide variety of errors.”
BackgroundMethodAutomated Program Repair from Fuzzing Perspective
Kim, Y., Han, S., Khamit, A. Y., & Yi, J. (2023) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3597926.3598101 · Cited by 11
“To prioritize patch candidates, existing APR approaches use various additional information such as code context [60], program contracts [45], code comments [67], Q&A sites [15], and existing patches [21, 25, 35].”
MethodUnderstanding the Non-Repairability Factors of Automated Program Repair Techniques
Lin, B., Wang, S., Wen, M., Zhang, Z., Wu, H., Qint, Y., & Mao, X. (2020) · Asia-Pacific Software Engineering Conference (APSEC) · doi:10.1109/apsec51365.2020.00015 · Cited by 7
“Each time a new technique is proposed, its authors made a comprehensive comparison against the studies in the literature to demonstrate its advances [5], [6].”
BackgroundMethodInfluentialExpanding Fix Patterns to Enable Automatic Program Repair
Nowack, V., Bowes, D., Counsell, S., Hall, T., Haraldsson, S. O., Winter, E., & Woodward, J. R. (2021) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre52982.2021.00015 · Cited by 9
“Using code similarity in APR helps to find fixes and apply them to buggy code [15], [18], [21], [22], [31].”
InfluentialUtilizing source code syntax patterns to detect bug inducing commits using machine learning models
Nadim, M., & Roy, B. (2022) · Software Quality Journal · doi:10.1007/s11219-022-09611-3 · Cited by 9
“There are a few more similar studies [33, 34, 49, 50] that investigated generating bug-fix patterns based on the existing commits patches and identical code fragments.”
BackgroundDetecting, Creating, Repairing, and Understanding Indivisible Multi-Hunk Bugs
Xin, Q., Wu, H., Tang, J., Liu, X., Reiss, S. P., & Xuan, J. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3660828 · Cited by 16
“…program location based on patterns for good patch construction (e.g., [42]) and bad patch identification [63], syntactic and semantic similarities (e.g., [1, 31, 69, 74, 78]), code synthesis (e.g., [23, 46, 76, 77]), program state analysis [13], bytecode mutation [24], and machine learning [88].”
BackgroundMethodTowards More Precise Coincidental Correctness Detection With Deep Semantic Learning
Xie, H., Lei, Y., Yan, M. L., Li, S., Mao, X., Yu, Y., & Lo, D. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2024.3481893 · Cited by 7
“For many APR techniques, the validation strategy is usually running failing tests first, and then passing tests [76], [77], [78], [79], [80], [81], [82].”
Enhancing Automated Program Repair with Solution Design
Zhao, J., Yang, D., Zhang, L., Lian, X., Yang, Z., & Liu, F. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695537 · Cited by 40
“Semantic search methods primarily focus on code similarity search, leveraging existing code repositories to find fixes that previously worked in similar contexts[17, 26].”
Yang, D., Lei, Y., Mao, X., Qi, Y., & Yi, X. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3561382 · Cited by 7
“An exceptional case is that these two strategies of SimFix achieved few improvements over the exhaustive strategy by correctly fixing at most two bugs in Defects4J.”
BackgroundMethodInfluentialSTART: A Framework for Trusted and Resilient Autonomous Vehicles (Practical Experience Report)
Leach, K., Timperley, C. S., Angstadt, K., Nguyen‐Tuong, A., Hiser, J. D., Paulos, A., Pal, P. P., Hurley, P., Thomas, C., Davidson, J. W., et al. (2022) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre55969.2022.00018 · Cited by 9
“Many other search-based repair approaches have been proposed with various repair operators [49], [45], [42], algorithms [8], [16], [19], [77], and optimizations [29], [82], [39].”
BackgroundVulRep: vulnerability repair based on inducing commits and fixing commits
Wei, Y., Bo, L., Wu, X., Li, Y., Ye, Z., Sun, X., & Li, B. (2023) · EURASIP Journal on Wireless Communications and Networking · doi:10.1186/s13638-023-02242-7 · Cited by 9
“AVR approaches based on heuristic search [17, 21–23] are the most widely researched class of approaches by far, and it has strong generality.”
MethodEnergy Consumption of Automated Program Repair
Martínez, M., Martínez‐Fernández, S., & Franch, X. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3639478.3643114 · Cited by 9
“In this study we select the following tools: Avatar [33], FixMiner [26], Nopol [65], SimFix [21], TBar [34], Dynamoth [13], jGenProg [44] (a Java implementation of GenProg [30] to repair Java bugs), jMutRepair [42], and kPAR [24] (implementation provided by [32]).”
MethodInfluentialTest-based patch clustering for automatically-generated patches assessment
Martínez, M., Kechagia, M., Perera, A., Petke, J., Sarro, F., & Aleti, A. (2024) · Empirical Software Engineering · doi:10.1007/s10664-024-10503-2 · Cited by 14
“ACS [24] 18 5 33 10 Arja [25] 18 171 17 77 Avatar [26] 53 67 3 2 CapGen [27] 28 38 Cardumen [28] 0 0 5 23 1 1 DeepRepair [29] 5 9 DynaMoth [30] 4 31 1 3 Elixir [31] 26 15 FixMiner [32] 52 57 GenProg-A [25] 10 49 HDRepair [33] 6 3 Jaid [34] 42 39 JGenprog [28] 5 7 11 25 0 2 JKali [28] 0 0 8 25 0 2 JMutRepair [28] 0 0 1…”
A Survey on Automatic Bug Fixing
Cao, H., Meng, Y., Shi, J., Li, L., Liao, T., & Zhao, C. (2020) · International Symposium on System and Software Reliability (ISSSR) · doi:10.1109/isssr51244.2020.00029 · Cited by 10
“Simfix [28] combined two data sources, the existing patches, and the source program.”
BackgroundHigh-Quality Automated Program Repair
Motwani, M. (2021) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion52605.2021.00134 · Cited by 11
“I evaluated four representative APR tools (GenProg [39], TrpAutoRepair [40], Par [41], and SimFix [16]) on 357 real-world defects in 5 large,”
BackgroundMethodFlexiRepair: Transparent Program Repair with Generic PatchesPreprint
Koyuncu, A., Bissyandé, T. F., Klein, J., & Traon, Y. L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13280 · Cited by 10
“Depending on how a technique conducts the search and constructs the patches, it can be considered as heuristics-based [14], [15], [7], [16] or constraint-based [17], [18], [19] following the taxonomy proposed by Le Goues et al. [11].”
BackgroundMethodLeakpair: Proactive Repairing of Memory Leaks in Single Page Web Applications
Shahoor, A., Khamit, A. Y., Yi, J., & Kim, D. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00097 · Cited by 5
“Researchers leveraged diverse sources of fix patterns, for example, Q&A posts [32], similar snippets [33], fault localization results [14], and static analysis warnings [39].”
BackgroundRepairCAT: Applying Large Language Model to Fix Bugs in AI-Generated Programs
Jiang, N., & Wu, Y. (2024) · doi:10.1145/3643788.3648020 · Cited by 9
“…DL models, these techniques learn diverse patterns of transforming buggy programs to patched programs from large code corpora, and many [10, 25, 27] outperform traditional template-based [7, 14], heuristic-based [19, 20, 26] and "a photo of pedestrians"constraint-based [16, 22, 23] APR techniques.”
ROSE: An IDE-Based Interactive Repair Framework for Debugging
Reiss, S. P., Wei, X., Yuan, J. P., & Xin, Q. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3705306 · Cited by 7
RetypeR: Integrated Retrieval-based Automatic Program Repair for Python Type Errors
Hao, S., Shi, X., & Liu, H. (2024) · IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsme58944.2024.00028 · Cited by 7
Evaluating the Generalizability of LLMs in Automated Program Repair
Li, F., Jiang, J., Sun, J., & Zhang, H. (2025) · IEEE/ACM International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER) · doi:10.1109/icse-nier66352.2025.00024 · Cited by 14
“As a result, Automated Program Repair (APR), which focuses on automatically fixing software bugs [1]– [6], has attracted considerable attention from academia and industry.”
Self-citationSpeedup Automatic Program Repair Using Dynamic Software Updating: An Empirical Study
Guo, R., Gu, T., Yao, Y., Xu, F., & Ma, X. (2019) · Asia-Pacific Symposium on Internetware · doi:10.1145/3361242.3361245 · Cited by 5
“Many approaches consider a particular set of code edits, i.e., patch ingredients, to shape a relatively small patch space, e.g., targeting condition statements [12, 34, 35] or using similar code [8].”
BackgroundBennett, G. J., Hall, T., & Bowes, D. (2022) · IEEE/ACM International Workshop on Automated Program Repair (APR) · doi:10.1145/3524459.3527348 · Cited by 5
“[11] created SimFix which uses the intersection between similar code and existing patches to filter patches.”
MethodRobustNPR: Evaluating the robustness of neural program repair models
Ge, H., Zhong, W., Li, C., Ge, J., Hu, H., & Luo, B. (2023) · Journal of Software Evolution and Process · doi:10.1002/smr.2586 · Cited by 8
Strider: Signal Value Transition-Guided Defect Repair for HDL Programming Assignments
Yang, D., He, J., Mao, X., Li, T., Lei, Y., Yi, X., & Wu, J. (2023) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2023.3341750 · Cited by 10
“…tens of APR techniques are proposed over the last decade, which can be classified as four types: 1) search-based (e.g., GenProg [58] and SimFix [44]); 2) constraint-based (e.g., JAID [59], [60] and Nopol [61]); 3) template-based (e.g., Tbar [39]); and 4) learning-based (e.g., RewardRepair…”
BackgroundMethodConfix: Combining node-level fix templates and masked language model for automatic program repair
Xiao, J., Xu, Z., Chen, S., Lei, G., Fan, G., Cao, Y., Deng, S., & Feng, Z. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112116 · Cited by 7
Wang, B., Liu, G., Lin, Y., Ren, S., Li, H., & Zhang, D. (2022) · Asia-Pacific Symposium on Internetware · doi:10.1145/3545258.3545286 · Cited by 5
“Specifically, inspired by other categories of repair approaches, MicroRepair filters the ingredients that can not fit the Java grammar [44], and discards the ingredients that are unrelated with the current context [13, 42].”
BackgroundCrossFix: Resolution of GitHub issues via similar bugs recommendation
Tan, S. H., Li, Z., & Yan, L. (2023) · Journal of Software Evolution and Process · doi:10.1002/smr.2554 · Cited by 7
Fault localization by analyzing failure propagation with samples in cloud computing environment
Wang, T., Wang, K., & Su, X. (2020) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-020-00164-z · Cited by 7
Improving Patch Quality by Enhancing Key Components of Automatic Program Repair
Soto, M. (2019) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2019.00147 · Cited by 9
Revisiting ssFix for Better Program RepairPreprint
Qi, X., & Reiss, S. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.04583 · Cited by 6
“It performs string matching on constraints rather than doing constraint-solving to identify semantics-related code. sharpFix is also related to the recent technique SimFix [18] which leverages similar code to produce patches.”
Metadata
- Authors
- Jiang, J., Xiong, Y., Zhang, H., Gao, Q., & Chen, X.
- Affiliations
- Peking University (CN)
- University of Newcastle Australia (AU)
- Venue
- Proceedings of the 27th ACM SIGSOFT International Symposium on Software Testing and Analysis
- Publisher
- ACM
- Published
- 2018-07-12
- Pages
- 298-309
- OpenAlex
- W2867448323
- Cited by
- 329
- References
- 72
- Citations by year
- 2026: 17 · 2025: 38 · 2024: 54 · 2023: 51 · 2022: 50 · 2021: 37 · 2020: 40 · 2019: 37 · 2018: 5
- FWCI
- 20.16
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) (publishedVersion)
- NOVA (University of Newcastle Australia) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Artificial Intelligence › Evolutionary Algorithms and Applications
- Keywords
- automated program repair, search space reduction, bug fixes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.