The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Prioritizing test cases for regression testing
Abstract
Test case prioritization techniques schedule test cases for execution in an order that attempts to increase their effectiveness at meeting some performance goal. Various goals are possible; one involves rate of fault detection, a measure of how quickly faults are detected within the testing process. An improved rate of fault detection during testing can provide faster feedback on the system under test and let software engineers begin correcting faults earlier than might otherwise be possible. One application of prioritization techniques involves regression testing, the retesting of software following modifications; in this context, prioritization techniques can take advantage of information gathered about the previous execution of test cases to obtain test case orderings. We describe several techniques for using test execution information to prioritize test cases for regression testing, including: 1) techniques that order test cases based on their total coverage of code components; 2) techniques that order test cases based on their coverage of code components not previously covered; and 3) techniques that order test cases based on their estimated ability to reveal faults in the code components that they cover. We report the results of several experiments in which we applied these techniques to various test suites for various programs and measured the rates of fault detection achieved by the prioritized test suites, comparing those rates to the rates achieved by untreated, randomly ordered, and optimally ordered suites.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1979) · Cited by 43,841
An Introduction to Statistical Methods and Data Analysis
(1994) · Technometrics · doi:10.1080/00401706.1994.10485832 · Cited by 5,346
Hints on Test Data Selection: Help for the Practicing Programmer
DeMillo, R. A., Lipton, R. J., & Sayward, F. G. (1978) · Computer · doi:10.1109/c-m.1978.218136 · Cited by 2,081
(1998) · PDCA/Test · doi:10.1201/9781420048131.axh · Cited by 1,900
An Introduction to Statistical Methods and Data Analysis
Prybutok, V. R. (1989) · Technometrics · doi:10.1080/00401706.1989.10488572 · Cited by 1,499
Coward, P. D. (1990) · The Software Life Cycle · doi:10.1016/b978-0-408-03741-9.50028-3 · Cited by 1,290
Selecting Software Test Data Using Data Flow Information
Rapps, S., & Weyuker, E. J. (1985) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1985.232226 · Cited by 1,075
The category-partition method for specifying and generating functional tests
Ostrand, T. J., & Balcer, M. J. (1988) · Communications of the ACM · doi:10.1145/62959.62964 · Cited by 791
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
Hutchins, M., Foster, H. D., Goradia, T., & Ostrand, T. J. (1994) · doi:10.5555/257734.257766 · Cited by 774
Software testing techniques (2nd ed.)
Beizer, B. (1990) · Cited by 744
A safe, efficient regression test selection technique
Rothermel, G., & Harrold, M. J. (1997) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/248233.248262 · Cited by 712
Self-citationAnalyzing regression test selection techniques
Rothermel, G., & Harrold, M. J. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.536955 · Cited by 708
Self-citationA methodology for controlling the size of a test suite
Harrold, M. J., Gupta, R., & Soffa, M. L. (1993) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/152388.152391 · Cited by 657
Self-citationAn experimental determination of sufficient mutant operators
Offutt, A. J., Lee, A., Rothermel, G., Untch, R. H., & Zapf, C. (1996) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/227607.227610 · Cited by 650
Self-citationTest case prioritization: an empirical study
Rothermel, G., Untch, R. H., Chu, C., & Harrold, M. J. (1999) · Proceedings IEEE International Conference on Software Maintenance - 1999 (ICSM'99). 'Software Maintenance for Business Change' (Cat. No.99CB36360) · doi:10.1109/icsm.1999.792604 · Cited by 625
Self-citationTesting Programs with the Aid of a Compiler
Hamlet, R. G. (1977) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1977.231145 · Cited by 612
Weak Mutation Testing and Completeness of Test Sets
Howden, W. E. (1982) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1982.235571 · Cited by 477
SAS for linear models : a guide to the ANOVA and GLM procedures
Freund, R. J., Littell, R. C., & Ray, A. A. (1981) · SAS Institute eBooks · Cited by 443
The detection of fault-prone programs
Munson, J. C., & Khoshgoftaar, T. M. (1992) · IEEE Transactions on Software Engineering · doi:10.1109/32.135775 · Cited by 442
PIE: a dynamic failure-based technique
Voas, J. M. (1992) · IEEE Transactions on Software Engineering · doi:10.1109/32.153381 · Cited by 402
A study of effective regression testing in practice
Wong, W. E., Horgan, J. R., London, S., & Agrawal, H. (2002) · Proceedings The Eighth International Symposium on Software Reliability Engineering · doi:10.1109/issre.1997.630875 · Cited by 390
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
Hutchins, M., Foster, H., Goradia, T., & Ostrand, T. (2002) · Proceedings of 16th International Conference on Software Engineering · doi:10.1109/icse.1994.296778 · Cited by 375
An empirical study of the effects of minimization on the fault detection capabilities of test suites
Rothermel, G., Harrold, M. J., Ostrin, J., & Hong, C. (2002) · International Conference on Software Maintenance · doi:10.1109/icsm.1998.738487 · Cited by 303
Self-citationTestTube: a system for selective regression testing
Chen, Y.-F. R., Rosenblum, D. S., & Vo, K.-P. (1994) · doi:10.5555/257734.257769 · Cited by 262
Regression testing in an industrial environment
Onoma, A. K., Tsai, W.-T., Poonawala, M., & Suganuma, H. (1998) · Communications of the ACM · doi:10.1145/274946.274960 · Cited by 223
A study of integration testing and software regression at the integration level
Leung, H. K. N., & White, L. (2002) · Proceedings. Conference on Software Maintenance 1990 · doi:10.1109/icsm.1990.131377 · Cited by 195
Helwig, J. T. (1978) · Medical Entomology and Zoology · Cited by 147
Hamlet, R. G. (1987) · Information Processing Letters · doi:10.1016/0020-0190(87)90088-3 · Cited by 80
Cited by
Regression testing minimization, selection and prioritization: a survey
Yoo, S., & Harman, M. (2012) · Software Testing, Verification and Reliability · doi:10.1002/stv.430 · Cited by 1,322
Do, H., Elbaum, S., & Rothermel, G. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3861-2 · Cited by 1,146
Self-citationTest case prioritization: a family of empirical studies
Elbaum, S., Malishevsky, A. G., & Rothermel, G. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988497 · Cited by 943
Self-citationVisualization of test information to assist fault localization
Jones, J. A., Harrold, M. J., & Stasko, J. (2002) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/581339.581397 · Cited by 904
Self-citationAutomatically finding patches using genetic programming
Weimer, W., Nguyen, T., Le Goues, C., & Forrest, S. (2009) · 2009 IEEE 31st International Conference on Software Engineering · doi:10.1109/icse.2009.5070536 · Cited by 761
Metadata
- Authors
- Rothermel, G., Untch, R. H., Chu, C., & Harrold, M. J.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2001-10
- Volume
- 27
- Issue
- 10
- Pages
- 929-948
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W2110068396
- Cited by
- 1,338
- References
- 28
- FWCI
- 44.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.