Theory and Practice, Do They Match? A Case with Spectrum-Based Fault Localization
The DOI matches its Crossref record.
Abstract
Spectrum-based fault localization refers to the process of identifying program units that are buggy from two sets of execution traces: normal traces and faulty traces. These approaches use statistical formulas to measure the suspiciousness of program units based on the execution traces. There have been many spectrum-based fault localization approaches proposing various formulas in the literature. Two of the best performing and well-known ones are Tarantula and Ochiai. Recently, Xie et al. find that theoretically, under certain assumptions, two families of spectrum-based fault localization formulas outperform all other formulas including those of Tarantula and Ochiai. In this work, we empirically validate Xie et al.'s findings by comparing the performance of the theoretically best formulas against popular approaches on a dataset containing 199 buggy versions of 10 programs. Our empirical study finds that Ochiai and Tarantula statistically significantly outperforms 3 out of 5 theoretically best fault localization techniques. For the remaining two, Ochiai also outperforms them, albeit not statistically significantly. This happens because an assumption in Xie et al.'s work is not satisfied in many fault localization settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
A Survey on Software Fault Localization
Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2521368 · Cited by 1,110
“Comparisons among different spectrum-based fault localization techniques are frequently discussed in recent studies [12], [210], [267], [371].”
BackgroundEvaluating and Improving Fault Localization
Pearson, S., Campos, J., Just, R., Fraser, G., Abreu, R., Ernst, M. D., Pang, D., & Keller, B. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.62 · Cited by 426
An Empirical Study of Fault Localization Families and Their Combinations
Zou, D., Liang, J., Xiong, Y., Ernst, M. D., & Zhang, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2892102 · Cited by 270
Towards Better Graph Neural Network-Based Fault Localization through Enhanced Code Representation
Rafi, M. N., Kim, D. J., Chen, A. R., Chen, T.-H. (., & Wang, S. (2024) · Proceedings of the ACM on Software Engineering · doi:10.1145/3660793 · Cited by 24
T-Rank:A Lightweight Spectrum based Fault Localization Approach for Microservice Systems
Ye, Z., Chen, P., & Yu, G. (2021) · 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid) · doi:10.1109/ccgrid51090.2021.00051 · Cited by 19
Metadata
- Authors
- Le, T.-D. B., Thung, F., & Lo, D.
- Venue
- 2013 IEEE International Conference on Software Maintenance
- Publisher
- IEEE
- Published
- 2013-09
- Pages
- 380-383
- ISSN
- 1063-6773 (ISSN-L)
- OpenAlex
- W2036853814
- Cited by
- 70
- References
- 0
- FWCI
- 2.76
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Theory and Practice, Do They Match? A Case with Spectrum-Based Fault Localization. https://app.cochat.ai/papers/10.1109/icsm.2013.52
- The paper
- Le, T.-D. B., Thung, F., & Lo, D. (2013). Theory and Practice, Do They Match? A Case with Spectrum-Based Fault Localization. 2013 IEEE International Conference on Software Maintenance. https://doi.org/10.1109/icsm.2013.52
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.