The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Regression testing minimization, selection and prioritization: a survey
Abstract
SUMMARY: Regression testing is a testing activity that is performed to provide confidence that changes do not harm the existing behaviour of the software. Test suites tend to grow in size as software evolves, often making it too costly to execute entire test suites. A number of different approaches have been studied to maximize the value of the accrued test suite: minimization, selection and prioritization. Test suite minimization seeks to eliminate redundant test cases in order to reduce the number of tests to run. Test case selection seeks to identify the test cases that are relevant to some set of recent changes. Test case prioritization seeks to order test cases in such a way that early fault detection is maximized. This paper surveys each area of minimization, selection and prioritization technique and discusses open problems and potential directions for future research. Copyright © 2010 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1979) · Cited by 43,841
Proceedings of the 25th international conference on Machine learning - ICML '08
(2008) · doi:10.1145/1390156 · Cited by 6,680
A Short Introduction to Boosting
Freund, Y., & Schapire, R. E. (1999) · Cited by 3,140
Search‐based software test data generation: a survey
McMinn, P. (2004) · Software Testing, Verification and Reliability · doi:10.1002/stvr.294 · Cited by 1,368
Prioritizing test cases for regression testing
Rothermel, G., Untch, R. H., Chu, C., & Harrold, M. J. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.962562 · Cited by 1,338
Do, H., Elbaum, S., & Rothermel, G. (2005) · Empirical Software Engineering · doi:10.1007/s10664-005-3861-2 · Cited by 1,146
Dynamically discovering likely program invariants to support program evolution
Ernst, M. D., Cockrell, J., Griswold, W. G., & Notkin, D. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.908957 · Cited by 1,050
Test case prioritization: a family of empirical studies
Elbaum, S., Malishevsky, A. G., & Rothermel, G. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/32.988497 · Cited by 943
Search Algorithms for Regression Test Case Prioritization
Li, Z., Harman, M., & Hierons, R. M. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.38 · Cited by 738
Self-citationA safe, efficient regression test selection technique
Rothermel, G., & Harrold, M. J. (1997) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/248233.248262 · Cited by 712
Analyzing regression test selection techniques
Rothermel, G., & Harrold, M. J. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.536955 · Cited by 708
A methodology for controlling the size of a test suite
Harrold, M. J., Gupta, R., & Soffa, M. L. (1993) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/152388.152391 · Cited by 657
An evaluation of methods for prioritizing software requirements
Karlsson, J., Wohlin, C., & Regnell, B. (1998) · Information and Software Technology · doi:10.1016/s0950-5849(97)00053-0 · Cited by 433
A study of effective regression testing in practice
Wong, W. E., Horgan, J. R., London, S., & Agrawal, H. (2002) · Proceedings The Eighth International Symposium on Software Reliability Engineering · doi:10.1109/issre.1997.630875 · Cited by 390
Experiments on the effectiveness of dataflow- and control-flow-based test adequacy criteria
Hutchins, M., Foster, H., Goradia, T., & Ostrand, T. (2002) · Proceedings of 16th International Conference on Software Engineering · doi:10.1109/icse.1994.296778 · Cited by 375
Yesterday, my program worked. Today, it does not. Why?
Zeller, A. (1999) · ACM SIGSOFT Software Engineering Notes · doi:10.1145/318774.318946 · Cited by 360
Pareto efficient multi-objective test case selection
Yoo, S., & Harman, M. (2007) · Proceedings of the 2007 international symposium on Software testing and analysis · doi:10.1145/1273463.1273483 · Cited by 357
Self-citation(1998) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(98)90683-6 · Cited by 342
TimeAware test suite prioritization
Walcott, K. R., Soffa, M. L., Kapfhammer, G. M., & Roos, R. S. (2006) · Proceedings of the 2006 international symposium on Software testing and analysis · doi:10.1145/1146238.1146240 · Cited by 340
On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques
Do, H., & Rothermel, G. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.92 · Cited by 287
Empirical studies of test‐suite reduction
Rothermel, G., Harrold, M. J., von Ronne, J., & Hong, C. (2002) · Software Testing, Verification and Reliability · doi:10.1002/stvr.256 · Cited by 253
Selecting a Cost-Effective Test Case Prioritization Technique
Elbaum, S. G., Rothermel, G., Kanduri, S., & Malishevsky, A. G. (2004) · Software Quality Journal · doi:10.1023/b:sqjo.0000034708.84524.22 · Cited by 246
Incremental program testing using program dependence graphs
Bates, S., & Horwitz, S. (1993) · Proceedings of the 20th ACM SIGPLAN-SIGACT symposium on Principles of programming languages - POPL '93 · doi:10.1145/158511.158694 · Cited by 222
A study of integration testing and software regression at the integration level
Leung, H. K. N., & White, L. (2002) · Proceedings. Conference on Software Maintenance 1990 · doi:10.1109/icsm.1990.131377 · Cited by 195
Automatically repairing event sequence-based GUI test suites for regression testing
Memon, A. M. (2008) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1416563.1416564 · Cited by 148
Proceedings International Conference on Software Maintenance ICSM 2003
(2003) · International Conference on Software Maintenance · doi:10.1109/icsm.2003.1235399 · Cited by 137
Test Case Prioritization Using Relevant Slices
Jeffrey, D., & Gupta, N. (2006) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac.2006.80 · Cited by 122
Cleve, A., Ricca, F., & Cerioli, M. (2013) · Proceedings of the ... European Conference on Software Maintenance and Reengineering/Proceedings of the European Conference on Software Maintenance and Reengineering · doi:10.1109/csmr.2013.1 · Cited by 119
On test suite composition and cost-effective regression testing
Rothermel, G., Elbaum, S. G., Malishevsky, A. G., et al. (2004) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/1027092.1027093 · Cited by 115
Efficient unit test case minimization
Leitner, A., Oriol, M., Zeller, A., et al. (2007) · doi:10.1145/1321631.1321698 · Cited by 108
Techniques for selective revalidation
Hartmann, J., & Robson, D. J. (1990) · IEEE Software · doi:10.1109/52.43047 · Cited by 103
Using the Case-Based Ranking Methodology for Test Case Prioritization
Tonella, P., Avesani, P., & Susi, A. (2006) · Proceedings/Proceedings - Conference on Software Maintenance · doi:10.1109/icsm.2006.74 · Cited by 91
Krishnamoorthi, R., & Mary, S. A. S. A. (2008) · Information and Software Technology · doi:10.1016/j.infsof.2008.08.007 · Cited by 90
Improving test suites via operational abstraction
Harder, M. P. F., Mellen, J., & Ernst, M. D. (2003) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1109/icse.2003.1201188 · Cited by 89
Understanding the effects of changes on the cost‐effectiveness of regression testing techniques
Elbaum, S. G., Kallakuri, P., Malishevsky, A. G., Rothermel, G., & Kanduri, S. (2003) · Software Testing Verification and Reliability · doi:10.1002/stvr.263 · Cited by 88
Proceedings 2004 International Symposium on Empirical Software Engineering
(2004) · International Symposium on Empirical Software Engineering · doi:10.1109/isese.2004.1334878 · Cited by 56
Proceedings of the 23rd IEEE/ACM International Conference on Automated Software Engineering
Hammouda, I., Mikkonen, T., Jazayeri, M., & Bosch, J. (2008) · Cited by 50
Software architecture-based regression testing
Muccini, H., Dias, M., & Richardson, D. J. (2006) · Journal of Systems and Software · doi:10.1016/j.jss.2006.02.059 · Cited by 39
Cited by
An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generation
Schäfer, M., Nadi, S., Eghbali, A., & Tip, F. (2024) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2023.3334955 · Cited by 431
Next Steps for Access to Safe, Secure DNA Synthesis
Diggans, J., & Leproust, E. (2019) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2019.00086 · Cited by 66
A large-scale longitudinal study of flaky tests
Lam, W., Winter, S., Wei, A., Xie, T., Marinov, D., & Bell, J. (2020) · Proceedings of the ACM on Programming Languages · doi:10.1145/3428270 · Cited by 64
Metadata
- Authors
- Yoo, S., & Harman, M.
- Venue
- Software Testing, Verification and Reliability
- Publisher
- Wiley
- Published
- 2012-03
- Volume
- 22
- Issue
- 2
- Pages
- 67-120
- ISSN
- 0960-0833 (ISSN-L)
- 1099-1689
- OpenAlex
- W4247801242
- Cited by
- 297
- References
- 43
- FWCI
- 67.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.