The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
A General Software Defect-Proneness Prediction Framework
Open accessAbstract
BACKGROUND - Predicting defect-prone software components is an economically important activity and so has received a good deal of attention. However, making sense of the many, and sometimes seemingly inconsistent, results is difficult. OBJECTIVE - We propose and evaluate a general framework for software defect prediction that supports 1) unbiased and 2) comprehensive comparison between competing prediction systems. METHOD - The framework is comprised of 1) scheme evaluation and 2) defect prediction components. The scheme evaluation analyzes the prediction performance of competing learning schemes for given historical data sets. The defect predictor builds models according to the evaluated learning scheme and predicts software defects with new data according to the constructed model. In order to demonstrate the performance of the proposed framework, we use both simulation and publicly available software defect data sets. RESULTS - The results show that we should choose different learning schemes for different data sets (i.e., no scheme dominates), that small details in conducting how evaluations are conducted can completely reverse findings, and last, that our proposed framework is more effective and less prone to bias than previous approaches. CONCLUSIONS - Failure to properly or fully evaluate a learning scheme can be misleading; however, these problems may be overcome by our proposed framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · Cited by 23,431
Wrappers for feature subset selection
Kohavi, R., & John, G. H. (1997) · Artificial Intelligence · doi:10.1016/s0004-3702(97)00043-x · Cited by 8,947
A validation of object-oriented design metrics as quality indicators
Basili, V. R., Briand, L. C., & Melo, W. L. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.544352 · Cited by 1,726
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
Hall, M. A. (2000) · Cited by 1,715
Benchmarking attribute selection techniques for discrete class data mining
Hall, M. A., & Holmes, G. (2003) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2003.1245283 · Cited by 1,232
Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
Data Mining Static Code Attributes to Learn Defect Predictors
Menzies, T., Greenwald, J., & Frank, A. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256941 · Cited by 1,215
A critique of software defect prediction models
Fenton, N. E., & Neil, M. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.815326 · Cited by 1,040
Predicting defect-prone software modules using support vector machines
Elish, K. O., & Elish, M. O. (2008) · Journal of Systems and Software · doi:10.1016/j.jss.2007.07.040 · Cited by 525
Machine learning approaches to estimating software development effort
Srinivasan, K., & Fisher, D. (1995) · IEEE Transactions on Software Engineering · doi:10.1109/32.345828 · Cited by 483
The detection of fault-prone programs
Munson, J. C., & Khoshgoftaar, T. M. (1992) · IEEE Transactions on Software Engineering · doi:10.1109/32.135775 · Cited by 442
Menzies, T., Dekhtyar, A., Distefano, J., & Greenwald, J. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70721 · Cited by 277
Robust Prediction of Fault-Proneness by Random Forests
Guo, L., Ma, Y., Cukic, B., & Singh, H. (2005) · 15th International Symposium on Software Reliability Engineering · doi:10.1109/issre.2004.35 · Cited by 271
Techniques for evaluating fault prediction models
Jiang, Y., Cukic, B., & Ma, Y. (2008) · Empirical Software Engineering · doi:10.1007/s10664-008-9079-3 · Cited by 267
Empirically guided software development using metric-based classification trees
Porter, A. A., & Selby, R. W. (1990) · IEEE Software · doi:10.1109/52.50773 · Cited by 264
Reliability and validity in comparative studies of software prediction models
Myrtveit, I., Stensrud, E., & Shepperd, M. (2005) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2005.58 · Cited by 259
Self-citationUsing Decision Trees to Improve Case-Based Learning
Cardie, C. (1993) · Machine Learning Proceedings 1993 · doi:10.1016/b978-1-55860-307-3.50010-1 · Cited by 255
Software defect association mining and defect correction effort prediction
Song, Q., Shepperd, M., Cartwright, M., & Mair, C. (2006) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2006.1599417 · Cited by 205
Self-citationKhoshgoftaar, T. M., Allen, E. B., Hudepohl, J. P., & Aud, S. J. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.595888 · Cited by 198
A comprehensive evaluation of capture-recapture models for estimating software defect content
Briand, L. C., El Emam, K., Freimut, B. G., & Laitenberger, O. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.852741 · Cited by 168
Comparing case-based reasoning classifiers for predicting high risk software components
El Emam, K., Benlarbi, S., Goel, N., & Rai, S. N. (2001) · Journal of Systems and Software · doi:10.1016/s0164-1212(00)00079-0 · Cited by 160
Learning Representative Exemplars of Concepts: An Initial Case Study
Kibler, D. F., & Aha, D. W. (1987) · Elsevier eBooks · doi:10.1016/b978-0-934613-41-5.50006-4 · Cited by 157
Analysis of Naive Bayes’ assumptions on software fault data: An empirical study
Turhan, B., & Bener, A. (2008) · Data & Knowledge Engineering · doi:10.1016/j.datak.2008.10.005 · Cited by 142
Comments on "Data Mining Static Code Attributes to Learn Defect Predictors"
Zhang, H., & Zhang, X. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70706 · Cited by 140
Fault Prediction Modeling for Software Quality Estimation: Comparing Commonly Used Techniques
Khoshgoftaar, T. M., & Seliya, N. (2003) · Empirical Software Engineering · doi:10.1023/a:1024424811345 · Cited by 128
Prediction and control of ADA software defects
Compton, B. T., & Withrow, C. (1990) · Journal of Systems and Software · doi:10.1016/0164-1212(90)90040-s · Cited by 120
Regression modelling of software quality: empirical investigation
Munson, J. C., & Khoshgoftaar, Y. M. (1990) · Information and Software Technology · doi:10.1016/0950-5849(90)90109-5 · Cited by 100
What do we know about defect detection methods? [software testing
Runeson, P., Andersson, C., Thelin, T., Andrews, A. K. A., & Berling, T. (2006) · IEEE Software · doi:10.1109/ms.2006.89 · Cited by 97
Estimating defects in commercial software during operational use
Kenny, G. Q. (1993) · IEEE Transactions on Reliability · doi:10.1109/24.210280 · Cited by 79
Runeson, P., & Wohlin, C. (1998) · Empirical Software Engineering · doi:10.1023/a:1009728205264 · Cited by 76
Evaluating capture-recapture models with two inspectors
Emam, K. E., & Laitenberger, O. (2001) · IEEE Transactions on Software Engineering · doi:10.1109/32.950319 · Cited by 63
Classification tree models of software quality over multiple releases
Khoshgoftaar, T. M., Allen, E. B., Jones, W. D., & HUDEPOHL, J. P. (2003) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.1999.809316 · Cited by 48
A practical method for the software fault-prediction
Li, Z., & Reformat, M. (2007) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2007.4296695 · Cited by 46
A Multivariate Analysis of Static Code Attributes for Defect Prediction
Turhan, B., & Bener, A. (2007) · Asia-Pacific Conference on Quality Software (APAQS) · doi:10.1109/qsic.2007.4385500 · Cited by 45
SOFTWARE DEFECT PREDICTION: HEURISTICS FOR WEIGHTED NAÏVE BAYES
Turhan, B., & Bener, A. (2007) · International Conference on Software and Data Technologies · doi:10.5220/0001339402440249 · Cited by 40
Using machine learning for estimating the defect content after an inspection
Padberg, F., Ragg, T., & Schoknecht, R. (2004) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2004.1265733 · Cited by 29
Discovering patterns in EEG-signals: Comparative study of a few methods
Kubát, M., Flotzinger, D., & Pfurtscheller, G. (1993) · Lecture notes in computer science · doi:10.1007/3-540-56602-3_152 · Cited by 26
Defect prediction for embedded software
Oral, A. D., & Bener, A. (2007) · International Symposium on Computer and Information Sciences · doi:10.1109/iscis.2007.4456886 · Cited by 23
Cited by
A Systematic Literature Review on Fault Prediction Performance in Software Engineering
Hall, T., Beecham, S., Bowes, D., Gray, D., & Counsell, S. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.103 · Cited by 1,154
“This is an important finding as it suggests that a relatively high number of papers reporting fault prediction are not really doing any prediction (this finding is also reported by [6]).”
A systematic review of machine learning techniques for software fault prediction
Malhotra, R. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2014.11.023 · Cited by 620
An Empirical Comparison of Model Validation Techniques for Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584050 · Cited by 574
Using Class Imbalance Learning for Software Defect Prediction
Wang, S., & Yao, X. (2013) · IEEE Transactions on Reliability · doi:10.1109/tr.2013.2259203 · Cited by 571
Data Quality: Some Comments on the NASA Software Defect Datasets
Shepperd, M., Song, Q., Sun, Z., & Mair, C. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.11 · Cited by 570
Self-citation
Metadata
- Authors
- Song, Q., Jia, Z., Shepperd, M., Ying, S., & Liu, J.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2011-05
- Volume
- 37
- Issue
- 3
- Pages
- 356-370
- ISSN
- 0098-5589 (ISSN-L)
- OpenAlex
- W2112658968
- Cited by
- 374
- References
- 38
- FWCI
- 29.82
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.