A Survey on Software Fault Localization
The DOI matches its Crossref record; 436 of the 451 references it cites were found in a registry or an index.
Abstract
Software fault localization, the act of identifying the locations of faults in a program, is widely recognized to be one of the most tedious, time consuming, and expensive - yet equally critical - activities in program debugging. Due to the increasing scale and complexity of software today, manually locating faults when failures occur is rapidly becoming infeasible, and consequently, there is a strong demand for techniques that can guide software developers to the locations of faults in a program with minimal human intervention. This demand in turn has fueled the proposal and development of a broad spectrum of fault localization techniques, each of which aims to streamline the fault localization process and make it more effective by attacking the problem in a unique way. In this article, we catalog and provide a comprehensive overview of such techniques and discuss key issues and concerns that are pertinent to software fault localization as a whole.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, Steinder et al. [21], Wong et al. [24], and Solé et al. [25] described the process of root-cause identification but did not focus on the microservices architecture.”
From Anomaly detection and root-cause identification in microservices: a survey (2026) · cites this paper as [24]
Citations
Cites
Cousot, P., & Cousot, R. (1977) · Proceedings of the 4th ACM SIGACT-SIGPLAN symposium on Principles of programming languages - POPL '77 · doi:10.1145/512950.512973 · Cited by 6,279 · cited 1×
“lem, Mayer and Stumptner [246] propose an abstractionbased model in which abstract interpretation [55], [78] is applied to handle loops, recursive procedures, and heap data structures.”
BackgroundBasic concepts and taxonomy of dependable and secure computing
Avizienis, A., Laprie, J.-C., Randell, B., & Landwehr, C. (2004) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2004.2 · Cited by 5,223 · cited 1×
“The following terms appear repeatedly throughout this article, and thus for convenience, we provide definitions for them here per the taxonomy provided in [37]: A failure is when a service deviates from its correct behavior.”
BackgroundCAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Weiser, M. (1984) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1984.5010248 · Cited by 3,204
A theory of diagnosis from first principles
Reiter, R. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90062-2 · Cited by 3,031 · cited 1×
“While using model-based diagnosis [301], it is assumed that a correct model of each program being diagnosed is available.”
MethodFundamentals of neural networks: architectures, algorithms, and applications
Fausett, L. V. (1994) · CERN Document Server (European Organization for Nuclear Research) · Cited by 3,025
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Theory of the backpropagation neural network
Hecht-Nielsen (1989) · International Joint Conference on Neural Networks · doi:10.1109/ijcnn.1989.118638 · Cited by 2,222
de Kleer, J., & Williams, B. C. (1987) · Artificial Intelligence · doi:10.1016/0004-3702(87)90063-4 · Cited by 2,039
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Research works printed but not linked: 17
- jannach, 0, Toward model-based debugging of spreadsheet programs, Proc Knowledge-Based Software Eng Conf, 252
- panko, 2006, Facing the problem of spreadsheet errors, Decision Line, 37, 8
- he, 0, Automated debugging using path-based weakest preconditions, Proc 8th Int Conf Fundam Approaches Softw Eng, 267
- lewis, 1973, Counterfactuals
- lucia lo, 0, Fusing fault localizers, IEEE Int Conf on Auto Soft Eng, 127
- lyle, 0, Automatic program bug location by program slicing, Proc Int Conf Comput Appl, 877
- grottke, 0, A classification of software faults, Proc 16th IEEE Int Symp Softw Rel Eng, 419
- mayer, 0, Prioritizing model-based debugging diagnostic reports, Proc Int Workshop Principles Diagnosis, 127
- mayer, 2004, Approximate modeling for debugging of program loops, Proc Int Workshop Principles Diagnosis, 87
- moon, 2014, Effective software fault localization using dynamic program behaviors, Master thesis
- gong, 0, Diversity maximization speedup for fault, Proc Int Conf Autom Softw Eng, 30
- torlak, 0, MemSAT: Checking axiomatic specifications of memory models, Proc ACM SIGPLAN Conf Programming Language Design and Implementation, 341
- vayani, 2007, Improving automatic software fault localization, Master thesis
- wu, 0, A statistical model to locate faults at input levels, Proc Int Conf Autom Softw Eng, 274
- collofello, 0, Towards automatic software fault localization through decision-to-decision path analysis, Proc Nat Comput Conf, 539
- stumptner, 0, Debugging functional program, Proc Int Joint Conf Artif Intell, 440
- xie, 0, Provably optimal and human-competitive results in SBSE for spectrum based fault localization, Proc 2nd Int Symp Search Based Software Eng, 224
Cited by
Items 801–900 of 1,006
Continuous Debugging of Microservices
Zhu, H., Bayley, I., & Wang, H. (2020) · IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA) · doi:10.1109/ispa-bdcloud-socialcom-sustaincom51426.2020.00118 · Cited by 2
“It is also worth noting that in recent years there has been a rapid growth in research on automated debugging; see [25] for a recent survey of research on the topic.”
BackgroundAI-based Spreadsheet Debugging
Schekotihin, K., Hofer, B., Wotawa, F., & Jannach, D. (2021) · WORLD SCIENTIFIC eBooks · doi:10.1142/9789811239922_0013 · Cited by 2
Self-citationA Review on Software Bug Localization Techniques using a Motivational Example
Mohsen, A. M., Hassan, H., Moawad, R., & Makady, S. H. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130231 · Cited by 5
“The bug localization process is the action of determining the location of the bug in the software program [8].”
MethodToward More Efficient Statistical Debugging with Abstraction Refinement
Zuo, Z., Niu, X., Zhang, S., Fang, L., Khoo, S., Lu, S., Sun, C. P., & Xu, G. H. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3544790 · Cited by 2
“Statistical debugging(13) [53, 66, 74] is a family of approaches that isolate a single suspicious element as the root cause of failure by identifying the discriminative behavior between passing and failing execution profiles.”
BackgroundTesting the prediction profiler with disallowed combinations—A statistical engineering case study
Ash, J. R., King, C., Lancaster, L., Lekivetz, R., Morgan, J., & Saanchi, Y. (2022) · Quality Engineering · doi:10.1080/08982112.2022.2135445 · Cited by 2
“Determining the cause of a failure is known as the fault localization problem (Wong et al. 2016).”
BackgroundCompetitive Debugging: Toward Contests Promoting Debugging as a Skill
Rein, P., Beckmann, T., Geier, L., Mattis, T., & Hirschfeld, R. (2022) · ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software (Onward!) · doi:10.1145/3563835.3567665 · Cited by 2
“Correspondingly, to improve debugging, the research communities on programming languages and software engineering have developed numerous debugging strategies and tools, such as generalized backward reasoning [33], time-travel debuggers [17, 24], and automatic debugging tools [32].”
BackgroundMapping Modern JVM Language Code to Analysis-Friendly Graphs: A Study with Kotlin
Li, L., & Liu, Y. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500735 · Cited by 2
Mukhtar, A., Hofer, B., Jannach, D., Wotawa, F., & Schekotihin, K. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559546 · Cited by 2
“In the context of debugging, adapting Spectrum-based Fault Localization (SFL) techniques [2, 26] for the spreadsheet domain proved to be effective [7, 9].”
MethodSelf-citationA Case Against Coverage-Based Program Spectra
Soha, P. A., Gergely, T., Horváth, F., Vancsics, B., & Beszédes, Á. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00011 · Cited by 2
“In Spectrum-Based Fault Localization (SBFL) [1], [2], [3], [4], [5], test executions are recorded to produce the program spectrum.”
BackgroundPoster: Improving Spectrum Based Fault Localization For Python Programs Using Weighted Code Elements
Sarhan, Q. I., & Beszédes, Á. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00055 · Cited by 2
“As a result, various software fault localization techniques, such as spectrum-based fault localization (SBFL) [1], have been proposed over the last few decades.”
BackgroundTowards Context-Aware Spectrum-Based Fault Localization
Szatmári, A. (2023) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst57152.2023.00060 · Cited by 2
“Many empirical studies have focused on understanding [1]–[5] and improving [6]–[10] Fault Localization.”
BackgroundStatement-Level Software Bug Localization Based on Information Retrieval and Spectrum
Li, J., Yue, L., Lan, W., & Cui, Z. (2023) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc53992.2023.10394134 · Cited by 2
“Wong et al. [6] found that Ochiai and DStar achieved the best localization results in empirical studies.”
BackgroundMethodRoca, I., Pastor, Ó., Cetina, C., & Arcega, L. (2024) · Information and Software Technology · doi:10.1016/j.infsof.2024.107412 · Cited by 3
Exploration of the scalability of LocFaultsPreprint
Bekkouche, M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.05508 · Cited by 2
“It consists of identifying the exact locations of suspicious instructions [18] to help the user to understand why the program failed, which facilitates him in the task of error correction.”
BackgroundAmortising the Cost of Mutation Based Fault Localisation using Statistical Inference.Preprint
Kim, J.-H., An, G., FELDT, R. H., & Yoo, S. (2019) · arXiv (Cornell University) · Cited by 2
Solver-Aided Constant-Time Circuit VerificationPreprint
Kıcı, R. G., Gleissenthall, K. V., Stefan, D., & Jhala, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.00461 · Cited by 2
“There are several approaches to help developers localize the root causes of software bugs [75].”
BackgroundImproving Test Distance for Failure Clustering with Hypergraph ModellingPreprint
An, G., Yoon, J., Whang, J. J., & Yoo, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2104.10360 · Cited by 2
“Fault Localisation (FL) aims to automatically identify the location of the root cause of the observed test failure [55], using various information such as program spectrum [21, 32, 54], mutation analysis [18, 31, 33, 34], and textual similarity between bug reports and source code [29, 41, 65].”
BackgroundUnderstanding Typing-Related Bugs in Solidity CompilerPreprint
Li, L., Pan, Y., Wang, D., Wu, J., & Yu, Z. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2512.18182 · Cited by 2
“The high correlation indicates that it would be fruitful to investigate automated localization (Du and Yu 2023; Wong et al. 2016; Yu et al. 2011, 2013, 2015) and fix (Baudry et al. 2021; Le Goues et al. 2012; Urli et al. 2018; Xue et al. 2025; Yang et al. 2025a,b; Yu et al. 2019, 2023) techniques…”
LIDL: LLM Integration Defect Localization via Knowledge Graph-Enhanced Multi-Agent AnalysisPreprint
Tan, G., He, Z., Li, M., Chen, P., Shi, J., Sun, Z., Zhang, T., Chen, D., Shar, L. K., Zhang, C., et al. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.05539 · Cited by 4
“Traditional defect localization aims to identify suspicious code regions responsible for software failures [28].”
Costiou, S. (2018) · theses.fr (ABES) · doi:10.70675/9b6e987czc813z4c96za3b2ze2ee5a7b5616 · Cited by 2
STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond
Dycke, N., Zečević, M., Kuznetsov, I., Suess, B., Kersting, K., & Gurevych, I. (2025) · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2025.acl-long.1107 · Cited by 1
“For instance, psychotherapists, programmers during debugging of source code, or engineers analyzing machine failures all use diagnostic reasoning (e.g. Mueller et al., 2012; Wong et al., 2016; Hameed et al., 2009; Magnani, 2023).”
Debugging with Probabilistic Event Structures
Soremekun, E. (2017) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-c.2017.34 · Cited by 1
“In the last three decades, there have been over 400 research papers proposing different debugging aids to support programmers in locating and fixing software faults [1].”
BackgroundA Fault Localization Approach Based on BiRNN and Multi-Dimensional Features
Yan, Y. P., Jiang, S., Wang, R., Zhang, C., Wang, C., Zhang, S., & Wen, M. (2022) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194022500425 · Cited by 1
Constraint-based debugging in probabilistic model checking
Debbi, H. (2022) · Computing · doi:10.1007/s00607-022-01130-0 · Cited by 1
“– Whilemost of debuggingmethods consider only faulty programswith a single fault [12], wewill show that ourmethod is efficient alsowithmodelswithmultiple faults (e.”
BackgroundMethodInfluentialShibboleth: Hybrid Patch Correctness Assessment in Automated Program Repair
Ghanbari, A., & Marcus, A. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3559519 · Cited by 2
“We compare the ranking capability of Shibboleth with state-of-the-art patch ranking systems CIP [22], ObjSim mh [5], an Ochiai-based [18] ranking approach, and a random baseline.”
MethodA Systematic Mapping of the Proposition of Benchmarks in the Software Testing and Debugging Domain
Silva-Junior, D., Neto, V. V. G., de Freitas, D. M., Leitao-Junior, P. S., & Kassab, M. (2023) · Software · doi:10.3390/software2040021 · Cited by 1
Glock, J. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3639478.3639783 · Cited by 1
“…behavior of a program has changed across versions [23], fault localization reports lines of code that might be the cause of unintended behaviors [27], and automated program repair aims to automatically fix programs that are crashing or otherwise failing tests after a modification has taken…”
BackgroundBounding Random Test Set Size with Computational Learning Theory
Walkinshaw, N., Foster, M., Rojas, J. M., & Hierons, R. M. (2024) · Proceedings of the ACM on software engineering. · doi:10.1145/3660819 · Cited by 3
“…have been proposed over the years [ , statement and branch coverage remain the most commonly used [35]. d In other words, when running random is a point of ‘diminishing returns’, where executing further tests to improve coverage is worthwhile. g One key criticism is that it is not decidable…”
Automated Repair of Violated Eventually Properties in Concurrent Programs
Faqrizal, I., Nivon, Q., & Salaün, G. (2024) · IEEE/ACM International Conference on Formal Methods in Software Engineering (FormaliSE) · doi:10.1145/3644033.3644383 · Cited by 1
Context Switch Sensitive Fault Localization
Horváth, F., Aszmann, R., Soha, P. A., Beszédes, Á., & Gyimóthy, T. (2024) · International Conference on Evaluation and Assessment in Software Engineering (EASE) · doi:10.1145/3661167.3661181 · Cited by 1
“…are then used in the formulas: 𝑒 ep : set of passed tests covering 𝑒 𝑒 ef : set of failed tests covering 𝑒 𝑒 nf : set of failed tests not covering 𝑒 𝑒 np : set of passed tests not covering 𝑒 A large number of different formulas using these basic statistics have been proposed [14, 28, 31].”
MethodSURE: A Visualized Failure Indexing Approach Using Program Memory Spectrum
Song, Y., Zhang, X., Xie, X., Chen, S., Liu, Q., & Gao, R. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3676958 · Cited by 1
Self-citationEffective fault localization using probabilistic and grouping approach
Srivastava, S. S., Dutta, A., & Mall, R. (2024) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-024-02479-5 · Cited by 1
“But eventually, it was realized that Tarantula was incapable of perfectly exploiting the relevant information carried by the successful and failed test case execution results.”
InfluentialIn Industrial Embedded Software, are Some Compilation Errors Easier to Localize and Fix than Others?
Han, F., Eldh, S., Wiklund, K., Ermedah, A., Haller, P., & Artho, C. V. (2024) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst60714.2024.00042 · Cited by 2
“Hence, automation of fault localization can be a key differentiating ability for any business or activity [6].”
BackgroundA generalized, rule-based method for the detection of intermittent faults in software programs
Sotiropoulos, P., & Vassilakis, C. (2024) · Journal of Systems and Software · doi:10.1016/j.jss.2024.112228 · Cited by 1
Do not neglect what's on your hands: localizing software faults with exception trigger stream
Zhang, X., Song, Y., Xie, X., Xin, Q., & Xing, C. (2024) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3691620.3695479 · Cited by 1
“Software debugging is a pivotal part of software quality assurance [39, 58, 59] and has received much attention from developers.”
StasogFL: A Fault Localization Method Based on Statement Association Graph
Guo, Y., Wang, S., An, D. U., & Luo, Y. (2024) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c63300.2024.00120 · Cited by 1
“This not only raises the difficulty of software development but also significantly increases the complexity and cost of software maintenance[2].”
BackgroundUniqueness of suspiciousness scores: towards boosting evolutionary fault localization
Ferreira, W. D. J., Leitao-Junior, P. S., de Freitas, D. M., Silva-Junior, D., & Harrison, R. (2024) · Journal of Software Engineering Research and Development · doi:10.5753/jserd.2024.3651 · Cited by 1
“The automation of the process of locating faults has been the subject of several studies in recent years, (Wong et al., 2016).”
BackgroundMethodInfluentialSoftware Fault Localization using CNN-LSTM Model
Singh, V. V., & Bisi, M. (2024) · International Conference on Computing, Communication and Networking Technologies (ICCCNT) · doi:10.1109/icccnt61001.2024.10725060 · Cited by 1
“There are many limitations of existing SBFL approaches [7] [8], including low accuracy, difficulty in handling multiple faults, and high computational cost.”
BackgroundSimulated Interactive Debugging
Noller, Y., Chandra, E., Srinidhi, H. C., Choo, K. T. W., Jégourel, C., Kurniawan, O., & POSKITT, C. M. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00338 · Cited by 2
“Based on the generated artifacts from techniques like spectrum-based fault localization (SBFL) [29], static code analysis, symbolic execution, code synthesis and LLM prompting, we can set breakpoints automatically, identify relevant variable values, and highlight them for the students.”
Coverage-Based Fault Localization in Haskell
Li, F., Wang, G., Wang, M., & Hao, D. (2025) · Journal of Computer Science and Technology · doi:10.1007/s11390-024-2967-1 · Cited by 1
ESfix: An Embedded Program Repair Tool for Effective Removal of Concurrency Defects
Zhao, J., Wu, Y., Fu, Y., & Liu, S. (2025) · Entropy · doi:10.3390/e27030294 · Cited by 2
“…program and evaluates the correctness of the patch using test cases as criteria and consists of three basic processes: fault location (FL) [33,34] to determine the location of potential programs that may cause bugs; patch generation (PG) generates a set of candidate patches that implement…”
Enhancing Spectrum-Based Fault Localization in the Context of Reactive Programming
Orban, A. J. (2025) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst62969.2025.10988988 · Cited by 1
“Several empirical studies have been based on understanding [1]–[5] and enhancing [6]– [10] spectrum-based Fault Localization in traditional programming paradigms such as object-oriented and imperative programming.”
Automated Repair of Cyber-Physical Systems
Valle, P. (2025) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse-companion66252.2025.00060 · Cited by 1
“Moreover, most APR techniques [10] incorporate a pre-processing phase using fault localization methods such as Spectrum-Based Fault Localization (SBFL) to prioritize suspicious code fragments, improving repair efficiency.”
InfluentialRefining Fuzzed Crashing Inputs for Better Fault Diagnosis
Kim, K. H., Lee, S., & Hong, S. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3731436 · Cited by 2
Capturing Semantic Flow of ML-based Systems
Yoo, S., FELDT, R. H., Kim, S., & Kim, N. (2025) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3696630.3728507 · Cited by 1
“For example, we may be able to perform something similar to Spectrum Based Fault Localisation [22]: if buggy executions of an LLM-based agent tend to cover a specific semantic cluster, while normal executions do not, we may expect that the specific reasoning step relevant to that semantic cluster…”
FairFLRep: Fairness-Aware Fault Localization and Repair of Deep Neural Networks
Openja, M., Arcaini, P., Khomh, F., & Ishikawa, F. (2025) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3766890 · Cited by 4
TailTracer: Continuous Tail Tracing for Production Use
Liu, T., Li, Y., Zhang, Y., Wang, Z., Wu, R., Li, X., & Zuo, Z. (2025) · Proceedings of the ACM on Programming Languages · doi:10.1145/3763109 · Cited by 1
Self-citationRevisit the Intuition of Mutation-Based Fault Localization in Real-world Programs
Xing, C., Chen, G., Xin, Q., & Xie, X. (2025) · Asia-Pacific Symposium on Internetware · doi:10.1145/3755881.3755919 · Cited by 1
“…in the real world does not directly imply that MBFL’s intuition also works in real-world scenarios, as MBFL’s fault localization capability is influenced by various factors [36], such as the risk evaluation formula, the quality of test cases, and additional information introduced to support MBFL.”
EAFL: an effective combination of features for fault localization in evolving programs
Aghazade-Par, F., & Vahidi-Asl, M. (2025) · Software Quality Journal · doi:10.1007/s11219-025-09732-5 · Cited by 1
“Additionally, a 2016 report highlighted that among all activities related to software debugging, fault localization accounts for 70 to 80% of the time spent on this process (Wong et al., 2016).”
Empirical Evaluation of LLMs for Automated Program Fault Localisation
Liu, Y., Wang, X., Liu, H., Huang, R., & Wu, Y. (2025) · IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) · doi:10.1109/qrs-c65679.2025.00063 · Cited by 1
“Existing methods—statistical, coverage-based, or ML-based [3]—often lack adaptability due to reliance on language, test quality, or code structure [4].”
InfluentialHuang, R., Yang, B., Wu, S., Li, Z., Doyle, P., Zhang, X., Chen, X., & Liu, Y. (2025) · Journal of Systems and Software · doi:10.1016/j.jss.2025.112700 · Cited by 1
Prompting is Helpful: Automated Deep Learning Framework Bug Replay with Large Language Models
Sun, J., Wang, Y., & Du, X. (2025) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew67781.2025.00061 · Cited by 1
Testing Open-World Games: A Minecraft Case Study
Chen, Q., Zhang, M., & Zhang, X. (2025) · IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) · doi:10.1109/issrew67781.2025.00059 · Cited by 1
“Game testing has long been a critical yet challenging task, especially as games continue to grow in complexity and scale [3], [4].”
Identifying Video Game Debugging Bottlenecks: An Industry Perspective
Gomez, C. P., & Petrillo, F. D. S. (2026) · IEEE/ACM International Workshop on Games and Software Engineering (GAS) · doi:10.1145/3786171.3788375 · Cited by 1
“However, this difference is mainly due to the game artifacts which produce unique visual aesthetics, interactivity demands from players, game rules, and systems [3].”
HLSTester: Efficient Testing of Behavioral Discrepancies with LLMs for High-Level Synthesis
Xu, K., Li, B., Zhang, G. L., & Schlichtmann, U. (2025) · doi:10.1109/iccad66269.2025.11240891 · Cited by 1
“Backward slicing is a program analysis technique that traces data dependencies in reverse from a target output to identify all variables that affect its value [36].”
Model-Based Diagnosis—European Perspectives and Contributions
Wotawa, F. (2025) · The European Journal on Artificial Intelligence · doi:10.1177/30504554251403464 · Cited by 1
“Wong et al. (2016) provided a survey on different techniques and methodologies for debugging.”
Self-citationMutants Will Tell: Statistical Mutation-Based Multiple Fault Localization for Deep Learning Programs
Xie, H., Deng, Z., Lei, Y., Li, M., Yan, M. L., & Lo, D. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3655800 · Cited by 1
“Like traditional programs [10], recent work has shown that DL programs inevitably contain faults [11], [12], [13], [14].”
Understanding Inconsistent State Update Vulnerabilities in Smart Contracts
Li, L., Chen, Y., Wu, J., Pan, Y., & Yu, Z. (2026) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3798052 · Cited by 4
“Implication 6 : There is no silver bullet for fixing inconsistent state update vulnerabilities, debugging tools should provide more bug manifestation information to help developers diagnosis and fix them.”
Diagnosing Violations of State-Based Specifications in iCFTL
Stratan, C., Mandrioli, C., & Bianculli, D. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3667445 · Cited by 1
“These techniques, such as the ones surveyed by Wong et al. [35], aim to identify the most likely faulty code segments by analysing the execution traces of successful and failed test cases.”
Extending Delta Debugging Minimization for Spectrum-Based Fault Localization
Kapugama, C. G. (2026) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc67433.2026.11393800 · Cited by 2
“This performance is better than, or comparable to, the results reported in recent works by Jones et al. [4] and Wong et al. [28] and Abreu et al. [29].”
SLMFL: Structural and semantic fusion for fault localization based on Small Language Models
Fan, X., Hu, J., Zheng, W., Liu, Y., & Gao, S. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108143 · Cited by 1
Railsback, S. F., Bliven, J., Grimm, V., & Kelter, J. (2026) · Ecological Modelling · doi:10.1016/j.ecolmodel.2026.111669 · Cited by 1
“Code testing technology (reviewed by Wong et al., 2016) has been developed since the earliest days of programming.”
Patricio, C., Zubasti, P., Berlanga, A., & Patricio, M. A. (2026) · Information and Software Technology · doi:10.1016/j.infsof.2026.108238 · Cited by 3
An Automated Methodology for Generating Labeled Datasets of Semantic Errors in Code
Kassem, M., Ribeiro, F., & Nadi, S. (2026) · International Workshop on Large Language Models for Code (LLM4Code) · doi:10.1145/3786181.3788730 · Cited by 2
DOTA: Intelligent Debugging with D elta o f T houghts A gents
Yang, R., Gupta, R., Zhang, Q., & Kundu, A. (2026) · ACM SIGOPS Operating Systems Review · doi:10.1145/3830422.3830424 · Cited by 1
“• Inconsistent Code Analysis : Effective debugging requires reliable, deep code understanding [7].”
Industrial Application of Deep Learning based Fault Localization with Mutation Features
Yang, H., Lee, A., Cho, K., & Kim, Y. (2026) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst69053.2026.00032 · Cited by 1
“Spectrum-Based Fault Localization identifies faults by analyzing program spectra to assign suspiciousness scores to 1 The specific names of certain internal departments or project teams have been anonymized or kept confidential to comply with security protocols individual code elements [15].”
He, M., Jia, T., Zhang, L., Duan, C., Zhao, X., Pan, L., Wang, C., Wang, K., Yu, Y., Zhang, L., et al. (2026) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3832783.3834433 · Cited by 1
“Fault diagnosis therefore provides guidance for debugging and recovery, improving system reliability [14, 48, 59, 62, 66].”
Self-citationVisual differential debugging in the domain-specific visual programming languages
Penev, A., & Vassilev, M. (2020) · International Conference Automatics and Informatics (ICAI) · doi:10.1109/icai50593.2020.9311308 · Cited by 1
“Developing features or conducting maintenance in such systems could easily cause unexpected behaviour, called regressions, in other parts of the same system that could be difficult t o i solate a nd r eproduce [ 3].”
BackgroundResearch on a Fault Repair Method for Control Logic of Non-Source-Code Software
Hu, P. F., Liu, X.-X., Gu, X.-F., Chen, H., Liu, K., & Zhang, C. (2021) · International Symposium on Computer Engineering and Intelligent Communications (ISCEIC) · doi:10.1109/isceic53685.2021.00066 · Cited by 1
Kirschner, L., Soremekun, E., & Zeller, A. (2020) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3377812.3390797 · Cited by 1
Experimental Fault Analysis Process Implemented Using Model Extraction and Model Checking
Ogawa, H., Ichii, M., Kumeno, F., & Aoki, T. (2015) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2015.118 · Cited by 1
“Several approaches to fault localization have been proposed[18].”
BackgroundAutomated Program Debugging for Multiple Bugs Based on Semantic Analysis
Liu, A., Li, L., & Luo, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-31220-0_7 · Cited by 1
Model-based embedded compiled software fault positioning
Liu, J., Chen, J., Zhang, W., Xu, X., & Yan, J. (2017) · Wuhan University Journal of Natural Sciences · doi:10.1007/s11859-017-1245-2 · Cited by 1
Context-Aware Debugging for Concurrent Programs
Chu, J. (2017) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2017.505 · Cited by 1
Towards a Testing Framework with Visual Feedback for Actor-Based Systems
Sözer, H., Gurler, O., & Yilmaz, O. (2018) · IEEE International Conference on Software Quality, Reliability and Security (QRS) · doi:10.1109/qrs.2018.00057 · Cited by 1
“There exist automated fault localization approaches that correlate faults with differences among program traces regarding passing and failing tests [16].”
BackgroundPoster: Pairika—A Failure Diagnosis Benchmark for C++ Programs
Rahman, M. R., Golagha, M., & Pretschner, A. (2018) · Cited by 1
A modular approach to integrate verification tools in model based development
Kanav, S. (2018) · ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C) · doi:10.1145/3270112.3275334 · Cited by 1
“Software fault localization has been an active area of research since the 1970s [48] and the following techniques have been developed: slice based, spectrum based, statistical, state based, machine learning based, data mining based, and model based.”
BackgroundComparing Spectrum Based Fault Localisation Against Test-to-Code Traceability Links
Laghari, G., Dahri, K., & Demeyer, S. (2018) · International Conference on Frontiers of Information Technology (FIT) · doi:10.1109/fit.2018.00034 · Cited by 1
“To help developers in fault localisation, the research community has forwarded the spectrum based fault localisation [5], [6], [7], [8], [9].”
BackgroundUsing LNT Formal Descriptions for Model-Based Diagnosis
Hofer, B., Mateescu, R., Serwe, W. B., & Wotawa, F. (2018) · HAL · Cited by 1
Self-citationSuspend-Less Debugging for Interactive and/or Realtime Programs
Tanno, H., & Iwasaki, H. (2019) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2019.00028 · Cited by 1
“[2] identified four types of classical debugging methods:”
MethodSpectrum-Based Fault Localization on a Collaboration Graph of a System-of-Systems
Shin, Y.-J., Hyun, S., Baek, Y., & Bae, D. (2019) · International Conference on System of Systems Engineering · doi:10.1109/sysose.2019.8753843 · Cited by 1
“as statements, predicates, or methods [5].”
BackgroundInfluentialA Fault Localization Method Based on Dynamic Failed Execution Blocks
Pan, B., Shu, T., Xia, J., Ding, Z., & Jiang, M. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-41418-4_21 · Cited by 1
Research and Implementation of a Software Runtime Fault Propagation Path Acquisition Method
Li, S., Lu, M., & Kong, S. (2019) · International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering · doi:10.1109/qr2mse46217.2019.9021165 · Cited by 1
“Based on the software fault propagation path, software developers can quickly locate the fault [2], troubleshoot the fault and reduce the software errors.”
MethodLightweight Fault Localization using Weighted Dynamic Control Flow Subgraph
Wang, Y., SanMing, L., Li, J., Cheng, X., & Zhou, W. (2020) · International Journal of Performability Engineering · doi:10.23940/ijpe.20.02.p6.214222 · Cited by 1
Using Algebra Graph Representation to Detect Pairwise-Constraint Software Faults
Wang, Y., Chen, X., Zhou, W., Liu, X., Li, J., & Lu, G. (2020) · IEEE Access · doi:10.1109/access.2020.3029094 · Cited by 1
“Although great progress has been made in software testing and localized automatically (such as spectrum-based Fault Localization techniques [5], [6]) in recent years, accurate fault localization for all existing faults is impossible due to the complexity and diversity of faults [7]–[9].”
BackgroundDetecting Dependencies Between Bug Reports to Improve Bugs Triage
Almhana, R., & Kessentini, M. (2020) · Deep Blue (University of Michigan) · Cited by 1
Applying learning techniques to oracle synthesis
Molina, F. (2020) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3324884.3415287 · Cited by 1
“generation [2, 22, 25], bug finding [12, 19], fault localization [35, 36] and program fixing [17, 26, 34], for which the need for program specifications becomes crucial.”
BackgroundSpectrum-Based Fault Localization for Multiple Faults
Xie, X., & Xu, B. (2020) · Springer eBooks · doi:10.1007/978-981-33-6179-9_8 · Cited by 1
A Multiple-Fault Localization Method for Embedded Software with Applications in Engineering
Kong, L., Wang, J., Zhou, S., & Wang, M. (2021) · Mathematical Problems in Engineering · doi:10.1155/2021/7038979 · Cited by 1
Gautham, S. (2020) · VCU Scholars Compass (Virginia Commonwealth University) · doi:10.25772/y4c5-zx85 · Cited by 1
Retrieval from software libraries for bug localization
Rao, S., & Kak, A. C. (2021) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/3468744.3468755 · Cited by 1
Applying Faulty Statement Category Frequency to Localize Faults for Student Programs
Li, Z., Zhou, X., Wu, Y., Liu, Y., & Chen, X. (2021) · International Conference on Computer Science & Education (ICCSE) · doi:10.1109/iccse51940.2021.9569698 · Cited by 2
Fault Localization-Guided Test Data Generation Approach for Novice Programs
Li, Z., Zhou, X., Yu, D., Wu, Y., Liu, Y., & Chen, X. (2021) · International Conference on Dependable Systems and Their Applications (DSA) · doi:10.1109/dsa52907.2021.00015 · Cited by 2
Repairing brain-computer interfaces with fault-based data acquisition
Winston, C., Winston, C., Winston, C. N., Winston, C., Winston, C., Rao, R. P. N., & Just, R. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3512764 · Cited by 1
“For example, statistical fault localization approaches aim to rank program elements by their suspiciousness [25, 35].”
BackgroundSchnappinger, M., Zachau, S., Fietzke, A., & Pretschner, A. (2022) · Lecture notes in business information processing · doi:10.1007/978-3-031-04115-0_4 · Cited by 3
Effective Lightweight Software Fault Localization based on Test Suite Optimization
Saxena, A., Bhatnagar, R., & Srivastava, D. K. (2022) · Innovations in Software Engineering Conference (ISEC) · doi:10.1145/3511430.3511437 · Cited by 1
“The Expense score metric is defined as the percentage of statements that need to be examined in a program before reaching to the first faulty statement [1], [11] Top-N.”
BackgroundHey APR! Integrate Our Fault Localization Skill: Toward Better Automated Program Repair
Yamate, K., Kondo, M., Kashiwa, Y., Kamei, Y., & Ubayashi, N. (2022) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac54236.2022.00101 · Cited by 1
Interacting with interactive fault localization tools
Horváth, F., Balogh, G., Szatmári, A., Sarhan, Q. I., Vancsics, B., & Beszédes, Á. (2022) · International Workshop on Automating Test Case Design, Selection and Evaluation (A-TEST) · doi:10.1145/3548659.3561311 · Cited by 1
“We present a technique and several tools to aid Spectrum-Based Fault Localization (SBFL), a class of FL methods popular among researchers [18].”
MethodDetecting Coincidental Correctness and Mitigating Its Impacts on Localizing Variability Faults
Nguyen, T.-T., & Vo, H. D. (2022) · International Conference on Knowledge and Systems Engineering/Proceedings · doi:10.1109/kse56063.2022.9953777 · Cited by 2
“Vector e = ⟨1, 1, 1, 0⟩ indicates the state of the test cases, where e[1] = 1 and e[4] = 0 mean that test t1 passed, and test t4 failed.”
BackgroundModel-Based Fault Classification for Automotive Software
Becker, M., Meyer, R., Runge, T., Schaefer, I., van der Wall, S., & Wolff, S. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21037-2_6 · Cited by 1
“Taking a step back, tests are designed by functionality or coverage, because it is hard to anticipate or even formulate possible faults in advance [45,47,50,51].”
Background
Metadata
- Authors
- Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F.
- Affiliations
- The University of Texas at Dallas (US)
- Palo Alto Research Center (US)
- Graz University of Technology (AT)
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2016-08-01
- Volume
- 42
- Issue
- 8
- Pages
- 707-740
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- OpenAlex
- W2343875716
- Cited by
- 1,110
- References
- 451
- Citations by year
- 2026: 91 · 2025: 96 · 2024: 127 · 2023: 113 · 2022: 132 · 2021: 118 · 2020: 117 · 2019: 117 · 2018: 88 · 2017: 54 · 2016: 26
- FWCI
- 324.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- IEEE Transactions on Software Engineering (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Software Testing and Debugging Techniques
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- software fault localization, debugging, automated fault diagnosis, software defects
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.