The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Ask the Mutants: Mutating Faulty Programs for Fault Localization
Abstract
We present MUSE (MUtation-baSEd fault localization technique), a new fault localization technique based on mutation analysis. A key idea of MUSE is to identify a faulty statement by utilizing different characteristics of two groups of mutants-one that mutates a faulty statement and the other that mutates a correct statement. We also propose a new evaluation metric for fault localization techniques based on information theory, called Locality Information Loss (LIL): it can measure the aptitude of a localization technique for automated fault repair systems as well as human debuggers. The empirical evaluation using 14 faulty versions of the five real-world programs shows that MUSE localizes a fault after reviewing 7.4 statements on average, which is about 25 times more precise than the state-of-the-art SBFL technique Op2.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
Étude comparative de la distribution florale dans une portion des Alpes et du Jura
Jaccard, P. (1901) · E-Periodica · doi:10.5169/seals-266450 · Cited by 2,353
Empirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,238
Do, H., Elbaum, S., & Rothermel, G. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3861-2 · Cited by 1,146
A Survey on Software Fault Localization
Wong, W. E., Gao, R., Li, Y., Abreu, R., & Wotawa, F. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2521368 · Cited by 1,110
GenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085
Automatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
Are automated debugging techniques actually helping programmers?
Parnin, C., & Orso, A. (2011) · Proceedings of the 2011 International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001445 · Cited by 576
Locating causes of program failures
Cleve, H., & Zeller, A. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062522 · Cited by 550
A model for spectra-based software diagnosis
Naish, L., Lee, H. J., & Ramamohanarao, K. (2011) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2000791.2000795 · Cited by 536
Fault localization with nearest neighbor queries
Renieres, M., & Reiss, S. P. (2004) · 18th IEEE International Conference on Automated Software Engineering, 2003. Proceedings. · doi:10.1109/ase.2003.1240292 · Cited by 427
A theoretical analysis of the risk evaluation formulas for spectrum-based fault localization
Xie, X., Chen, T. Y., Kuo, F.-C., & Xu, B. (2013) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/2522920.2522924 · Cited by 353
A systematic study of automated program repair: Fixing 55 out of 105 bugs for $8 each
Le Goues, C., Dewey-Vogt, M., Forrest, S., & Weimer, W. (2012) · 2012 34th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2012.6227211 · Cited by 326
Locating faults through automated predicate switching
Zhang, X., Gupta, N., & Gupta, R. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134324 · Cited by 277
Zoogeographical Studies on the Soleoid Fishes found in Japan and its Neighbouring Regions-I
OCHIAI, A. (1957) · NIPPON SUISAN GAKKAISHI · doi:10.2331/suisan.22.522 · Cited by 272
Mutation analysis of program test data
Budd, T. A. (1980) · Cited by 236
Effective Fault Localization using Code Coverage
Wong, W. E., Qi, Y., Zhao, L., & Cai, K.-Y. (2007) · 31st Annual International Computer Software and Applications Conference - Vol. 1- (COMPSAC 2007) · doi:10.1109/compsac.2007.109 · Cited by 205
Fault localization using value replacement
Jeffrey, D., Gupta, N., & Gupta, R. (2008) · Proceedings of the 2008 international symposium on Software testing and analysis · doi:10.1145/1390630.1390652 · Cited by 167
Evolving Human Competitive Spectra-Based Fault Localisation Techniques
Yoo, S. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-33119-0_18 · Cited by 142
Self-citationChandra, S., Torlak, E., Barman, S., & Bodík, R. (2011) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/1985793.1985811 · Cited by 132
Using Mutants to Locate "Unknown" Faults
Papadakis, M., & Traon, Y. L. (2012) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2012.159 · Cited by 110
Using automated program repair for evaluating the effectiveness of fault localization techniques
Qi, Y., Mao, X., Lei, Y., & Wang, C. (2013) · International Symposium on Software Testing and Analysis · doi:10.1145/2483760.2483785 · Cited by 99
Lightweight bug localization with AMPLE
Dallmeier, V., Lindig, C., & Zeller, A. (2005) · doi:10.1145/1085130.1085143 · Cited by 95
Provably Optimal and Human-Competitive Results in SBSE for Spectrum Based Fault Localisation
Xie, X., Kuo, F., Chen, T. Y., Yoo, S., & Harman, M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39742-4_17 · Cited by 91
Self-citationVisualization for Fault Localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2003) · Cited by 83
Injecting mechanical faults to localize developer faults for evolving software
Zhang, L., Zhang, L., & Sarfraz Khurshid, D. (2013) · Conference on Object-Oriented Programming Systems, Languages, and Applications · doi:10.1145/2509136.2509551 · Cited by 75
Isolating failure causes through test case generation
Röβler, J., Fraser, G., Zeller, A., & Orso, A. (2012) · International Symposium on Software Testing and Analysis · doi:10.1145/2338965.2336790 · Cited by 73
F3: fault localization for field failures
Jin, W., & Orso, A. (2013) · International Symposium on Software Testing and Analysis · doi:10.1145/2483760.2483763 · Cited by 72
Automated unit testing of large industrial embedded software using concolic testing
Kim, Y., Kim, Y., Kim, T., Lee, G., Jang, Y., & Kim, M. (2013) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2013.6693109 · Cited by 40
Self-citationImproving the effectiveness of spectra-based fault localization using specifications
Gopinath, D., Zaeem, R. N., & Sarfraz Khurshid, D. (2012) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/2351676.2351683 · Cited by 31
Cited by
Demystifying LLM-Based Software Engineering Agents
Xia, C. S., Deng, Y., Dunn, S., & Zhang, L. (2025) · Proceedings of the ACM on Software Engineering · doi:10.1145/3715754 · Cited by 849
“Dynamic FL techniques mainly include spectrum-based FL (SBFL) [Abreu et al. 2009, 2007; Jones and Harrold 2005] and mutation-based FL (MBFL) [Lou et al. 2020; Moon et al. 2014; Papadakis and Le Traon 2015].”
Evaluating and Improving Fault Localization
Pearson, S., Campos, J., Just, R., Fraser, G., Abreu, R., Ernst, M. D., Pang, D., & Keller, B. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.62 · Cited by 426
Mutation Testing Advances: An Analysis and Survey
(2019) · Advances in Computers · doi:10.1016/bs.adcom.2018.03.015 · Cited by 425
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
An Empirical Study of Fault Localization Families and Their Combinations
Zou, D., Liang, J., Xiong, Y., Ernst, M. D., & Zhang, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2892102 · Cited by 270
Metadata
- Authors
- Moon, S., Kim, Y., Kim, M., & Yoo, S.
- Venue
- 2014 IEEE Seventh International Conference on Software Testing, Verification and Validation
- Publisher
- IEEE
- Published
- 2014-03
- Pages
- 153-162
- OpenAlex
- W1990785546
- Cited by
- 291
- References
- 30
- FWCI
- 7.52
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.