The DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Metallaxis‐FL: mutation‐based fault localization
Open accessAbstract
Summary: Fault localization methods seek to identify faulty program statements based on the information provided by the failing and passing test executions. Spectrum‐based methods are among the most popular ones and assist programmers by assigning suspiciousness values on program statements according to their probability of being faulty. This paper proposes Metallaxis, a fault localization approach based on mutation analysis. The innovative part of Metallaxis is that it uses mutants and links them with the faulty program places. Thus, mutants that are killed mostly by failing tests provide a good indication about the location of a fault. Experimentation using Metallaxis suggests that it is significantly more effective than statement‐based approaches. This is true even in the case where mutation cost‐reduction techniques, such as mutant sampling, are facilitated. Additionally, results from a controlled experiment show that the use of mutation as a testing technique provides benefits to the fault localization process. Therefore, fault localization is significantly improved by using mutation‐based tests instead of block‐based or branch‐based test suites. Finally, evidence in support of the methods’ scalability is also given. Copyright © 2013 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hints on Test Data Selection: Help for the Practicing Programmer
DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978) · Computer · doi:10.1109/c-m.1978.218136 · Cited by 2,081
An Analysis and Survey of the Development of Mutation Testing
Jia, Y., & Harman, M. (2011) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.62 · Cited by 1,745
Empirical evaluation of the tarantula automatic fault-localization technique
Jones, J. A., & Harrold, M. J. (2005) · Proceedings of the 20th IEEE/ACM International Conference on Automated Software Engineering · doi:10.1145/1101908.1101949 · Cited by 1,238
Do, H., Elbaum, S., & Rothermel, G. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3861-2 · Cited by 1,146
Simplifying and isolating failure-inducing input
Zeller, A., & Hildebrandt, R. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988498 · Cited by 1,079
Visualization of test information to assist fault localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2002) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/581339.581397 · Cited by 904
Is mutation an appropriate tool for testing experiments?
Andrews, J. H., Briand, L. C., & Labiche, Y. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062530 · Cited by 777
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
Hutchins, M., Foster, H. D., Goradia, T., & Ostrand, T. J. (1994) · doi:10.5555/257734.257766 · Cited by 774
On the Accuracy of Spectrum-based Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2007) · Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007) · doi:10.1109/taic.part.2007.13 · Cited by 736
An experimental determination of sufficient mutant operators
Offutt, A. J., Lee, A., Rothermel, G., Untch, R. H., & Zapf, C. (1996) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/227607.227610 · Cited by 650
Are automated debugging techniques actually helping programmers?
Parnin, C., & Orso, A. (2011) · Proceedings of the 2011 International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001445 · Cited by 576
Locating causes of program failures
Cleve, H., & Zeller, A. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062522 · Cited by 550
Isolating cause-effect chains from computer programs
Zeller, A. (2002) · Proceedings of the 10th ACM SIGSOFT symposium on Foundations of software engineering · doi:10.1145/587051.587053 · Cited by 530
Visualization of test information to assist fault localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2002) · Proceedings of the 24th international conference on Software engineering - ICSE '02 · doi:10.1145/581396.581397 · Cited by 524
Using Mutation Analysis for Assessing and Comparing Testing Coverage Criteria
Andrews, J. H., Briand, L. C., Labiche, Y., & Namin, A. S. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.83 · Cited by 481
Spectrum-Based Multiple Fault Localization
Abreu, R., Zoeteweij, P., & van Gemund, A. J. C. (2009) · 2009 IEEE/ACM International Conference on Automated Software Engineering · doi:10.1109/ase.2009.25 · Cited by 401
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
Hutchins, M., Foster, H., Goradia, T., & Ostrand, T. (2002) · Proceedings of 16th International Conference on Software Engineering · doi:10.1109/icse.1994.296778 · Cited by 375
Mutation 2000: Uniting the Orthogonal
Offutt, A. J., & Untch, R. H. (2001) · Springer eBooks · doi:10.1007/978-1-4757-5939-6_7 · Cited by 374
Is mutation an appropriate tool for testing experiments?
Andrews, J. H., Brand, L. C., & Labiche, Y. (2005) · Proceedings. 27th International Conference on Software Engineering, 2005. ICSE 2005. · doi:10.1109/icse.2005.1553583 · Cited by 368
SOBER: statistical model-based bug localization
Liu, C., Yan, X., Fei, L., Han, J., & Midkiff, S. P. (2005) · Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering · doi:10.1145/1081706.1081753 · Cited by 357
Jia, Y., & Harman, M. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2009.04.016 · Cited by 287
Mutation-Driven Generation of Unit Tests and Oracles
Fraser, G., & Zeller, A. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.93 · Cited by 283
Lightweight fault-localization using multiple coverage types
Santelices, R., Jones, J. A., Yu, Y., & Harrold, M. J. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070508 · Cited by 264
A family of code coverage-based heuristics for effective fault localization
Eric Wong, W., Debroy, V., & Choi, B. (2010) · Journal of Systems and Software · doi:10.1016/j.jss.2009.09.037 · Cited by 230
Using Mutation to Automatically Suggest Fixes for Faulty Programs
Debroy, V., & Wong, W. E. (2010) · 2010 Third International Conference on Software Testing, Verification and Validation · doi:10.1109/icst.2010.66 · Cited by 226
Improving test suites for efficient fault localization
Baudry, B., Fleurey, F., & Le Traon, Y. (2006) · Proceedings of the 28th international conference on Software engineering · doi:10.1145/1134285.1134299 · Cited by 194
Self-citationFault localization using value replacement
Jeffrey, D., Gupta, N., & Gupta, R. (2008) · Proceedings of the 2008 international symposium on Software testing and analysis · doi:10.1145/1390630.1390652 · Cited by 167
Improving test suites via operational abstraction
Harder, M. P. F., Mellen, J., & Ernst, M. D. (2003) · doi:10.5555/776816.776824 · Cited by 163
Mutation-driven generation of unit tests and oracles
Fraser, G., & Zeller, A. (2010) · International Symposium on Software Testing and Analysis · doi:10.1145/1831708.1831728 · Cited by 159
Automatic Mutation Test Case Generation via Dynamic Symbolic Execution
Papadakis, M., & Malevris, N. (2010) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2010.38 · Cited by 127
Self-citationLiu, C., Yan, X., Long, F., Han, J., & Midkiff, S. P. (2005) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/1095430.1081753 · Cited by 117
Using Mutants to Locate "Unknown" Faults
Papadakis, M., & Traon, Y. L. (2012) · IEEE International Conference on Software Testing, Verification and Validation (ICST) · doi:10.1109/icst.2012.159 · Cited by 110
Self-citationThe Probabilistic Program Dependence Graph and Its Application to Fault Diagnosis
Baah, G. K., Podgurski, A., & Harrold, M. J. (2010) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2009.87 · Cited by 105
Improving test suites via operational abstraction
Harder, M. P. F., Mellen, J., & Ernst, M. D. (2003) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1109/icse.2003.1201188 · Cited by 89
Papadakis, M., & Malevris, N. (2011) · Software Quality Journal · doi:10.1007/s11219-011-9142-y · Cited by 70
Self-citationMutation based test case generation via a path selection strategy
Papadakis, M., & Malevris, N. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.02.004 · Cited by 68
Self-citationEvaluating the Accuracy of Fault Localization Techniques
Ali, S., Andrews, J. H., Dhandapani, T., & Wang, W. (2009) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2009.89 · Cited by 62
Minimizing reproduction of software failures
Burger, M., & Zeller, A. (2011) · International Symposium on Software Testing and Analysis · doi:10.1145/2001420.2001447 · Cited by 57
Whole execution traces and their applications
Zhang, X., & Gupta, R. (2005) · ACM Transactions on Architecture and Code Optimization · doi:10.1145/1089008.1089012 · Cited by 46
On the use of mutations and testing for debugging
Nica, M., Nica, S., & Wotawa, F. (2012) · Software Practice and Experience · doi:10.1002/spe.1142 · Cited by 25
Cited by
Evaluating and Improving Fault Localization
Pearson, S., Campos, J., Just, R., Fraser, G., Abreu, R., Ernst, M. D., Pang, D., & Keller, B. (2017) · 2017 IEEE/ACM 39th International Conference on Software Engineering (ICSE) · doi:10.1109/icse.2017.62 · Cited by 426
Mutation Testing Advances: An Analysis and Survey
(2019) · Advances in Computers · doi:10.1016/bs.adcom.2018.03.015 · Cited by 425
An analysis of patch plausibility and correctness for generate-and-validate patch generation systems
Qi, Z., Long, F., Achour, S., & Rinard, M. (2015) · Proceedings of the 2015 International Symposium on Software Testing and Analysis · doi:10.1145/2771783.2771791 · Cited by 420
DeepFL: integrating multiple fault diagnosis dimensions for deep fault localization
Li, X., Li, W., Zhang, Y., & Zhang, L. (2019) · Proceedings of the 28th ACM SIGSOFT International Symposium on Software Testing and Analysis · doi:10.1145/3293882.3330574 · Cited by 336
An Empirical Study of Fault Localization Families and Their Combinations
Zou, D., Liang, J., Xiong, Y., Ernst, M. D., & Zhang, L. (2021) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2892102 · Cited by 270
Metadata
- Authors
- Papadakis, M., & Le Traon, Y.
- Venue
- Software Testing, Verification and Reliability
- Publisher
- Wiley
- Published
- 2013-09-09
- Volume
- 25
- Issue
- 5-7
- Pages
- 605-628
- ISSN
- 0960-0833 (ISSN-L)
- 1099-1689
- OpenAlex
- W1950030762
- Cited by
- 371
- References
- 40
- FWCI
- 21.53
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.