The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
An experimental determination of sufficient mutant operators
Open accessAbstract
Mutation testing is a technique for unit-testing software that, although powerful, is computationally expensive, The principal expense of mutation is that many variants of the test program, called mutants, must be repeatedly executed.This article quantifies the expense of mutation in terms of the number of mutants that are created, then proposes and evaluates a technique that reduces the number of mutants by an order of magnitude.Selective mutation reduces.the cost of mutation testing by reducing the number of mutants, This article reports experimental results that compare selective mutation testing with standard, or nonselective, mutation testing, and results that quantify the savings achieved by selective mutation testing, The results support the hypothesis that selective mutation is almost as strong as nonselective mutation: in experimental trials selective mutation provides almost the same coverage as nonselective mutation.with a four-fold or more reduction in the number of mutants.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An Introduction to Statistical Methods and Data Analysis
(1994) · Technometrics · doi:10.1080/00401706.1994.10485832 · Cited by 5,346
Hints on Test Data Selection: Help for the Practicing Programmer
DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978) · Computer · doi:10.1109/c-m.1978.218136 · Cited by 2,081
An Introduction to Statistical Methods and Data Analysis
Prybutok, V. R. (1989) · Technometrics · doi:10.1080/00401706.1989.10488572 · Cited by 1,499
Constraint-based automatic test data generation
DeMilli, R. A., & Offutt, A. J. (1991) · IEEE Transactions on Software Engineering · doi:10.1109/32.92910 · Cited by 804
Self-citationTesting Programs with the Aid of a Compiler
Hamlet, R. G. (1977) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1977.231145 · Cited by 612
SAS for linear models : a guide to the ANOVA and GLM procedures
Freund, R. J., Littell, R. C., & Ray, A. A. (1981) · SAS Institute eBooks · Cited by 443
A fortran language system for mutation‐based software testing
King, K. N., & Offutt, A. J. (1991) · Software: Practice and Experience · doi:10.1002/spe.4380210704 · Cited by 379
Self-citationInvestigations of the software testing coupling effect
Offutt, A. J. (1992) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/125489.125473 · Cited by 371
Self-citationTwo notions of correctness and their relation to testing
Budd, T. A., & Angluin, D. (1982) · Acta Informatica · doi:10.1007/bf00625279 · Cited by 260
An extended overview of the Mothra software testing environment
DeMillo, R. A., Guindi, D. S., McCracken, W. M., Offutt, A. J., & King, K. N. (2003) · [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis · doi:10.1109/wst.1988.5369 · Cited by 257
Self-citationAn experimental evaluation of selective mutation
Offutt, A. J., Rothermel, G., & Zapf, C. (1993) · doi:10.5555/257572.257597 · Cited by 244
Self-citationProceedings of 1993 15th International Conference on Software Engineering
(1993) · Proceedings of 1993 15th International Conference on Software Engineering · doi:10.1109/icse.1993.346061 · Cited by 240
Mutation analysis of program test data
Budd, T. A. (1980) · Cited by 236
An empirical evaluation of weak mutation
Offutt, A. J., & Lee, S. D. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.286422 · Cited by 192
Self-citationMutation analysis using mutant schemata
Untch, R. H., Offutt, A. J., & Harrold, M. J. (1993) · Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis · doi:10.1145/154183.154265 · Cited by 187
Self-citationPerformance, effectiveness, and reliability issues in software testing
Mathur, A. P. (2002) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/cmpsac.1991.170248 · Cited by 168
An empirical comparison of data flow and mutation‐based test adequacy criteria
Mathur, A. P., & Wong, W. E. (1994) · Software Testing Verification and Reliability · doi:10.1002/stvr.4370040104 · Cited by 137
Experimental results from an automatic test case generator
DeMillo, R. A., & Offutt, A. J. (1993) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/151257.151258 · Cited by 132
Self-citationAcree, A. T., Budd, T. A., DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1979) · Defense Technical Information Center (DTIC) · doi:10.21236/ada076575 · Cited by 129
Wong, W. E. (1993) · Cited by 81
A Theory of Error-Based Testing.
Morell, L. J. (1984) · Defense Technical Information Center (DTIC) · doi:10.21236/ada143533 · Cited by 77
High-performance mutation testing
Byoungju, C., & Mathur, A. P. (1993) · Journal of Systems and Software · doi:10.1016/0164-1212(93)90005-i · Cited by 61
An Integrated Automatic Test Data Generation System
Offutt, A. J. (1991) · Springer eBooks · doi:10.1007/978-1-4615-3644-4_7 · Cited by 42
Self-citationFault coupling in finite bijective functions
Wah, K. S. H. T. (1995) · Software Testing Verification and Reliability · doi:10.1002/stvr.4370050103 · Cited by 32
An integrated automatic test data generation system
Offutt, A. J. (1991) · Journal of Systems Integration · doi:10.1007/bf02262722 · Cited by 27
Self-citation
Cited by
An Analysis and Survey of the Development of Mutation Testing
Jia, Y., & Harman, M. (2011) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2010.62 · Cited by 1,745
Prioritizing test cases for regression testing
Rothermel, G., Untch, R. H., Chu, C., & Harrold, M. J. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.962562 · Cited by 1,338
Self-citationDo, H., Elbaum, S., & Rothermel, G. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3861-2 · Cited by 1,146
Self-citationIntroduction to Software Testing
(2021) · Essentials of Software Testing · doi:10.1017/9781108974073.004 · Cited by 1,056
Test case prioritization: a family of empirical studies
Elbaum, S., Malishevsky, A. G., & Rothermel, G. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988497 · Cited by 943
Self-citation
Metadata
- Authors
- Offutt, A. J., Lee, A., Rothermel, G., Untch, R. H., & Zapf, C.
- Venue
- ACM Transactions on Software Engineering and Methodology
- Published
- 1996-04
- Volume
- 5
- Issue
- 2
- Pages
- 99-118
- ISSN
- 1049-331X (ISSN-L)
- 1557-7392
- OpenAlex
- W2121084350
- Cited by
- 650
- References
- 25
- FWCI
- 25.11
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.