The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Data Mining Static Code Attributes to Learn Defect Predictors
Abstract
The value of using static code attributes to learn defect predictors has been widely debated. Prior work has explored issues like the merits of "McCabes versus Halstead versus lines of code counts" for generating defect predictors. We show here that such debates are irrelevant since how the attributes are used to build predictors is much more important than which particular attributes are used. Also, contrary to prior pessimism, we show that such defect predictors are demonstrably useful and, on the data studied here, yield predictors with a mean probability of detection of 71 percent and mean false alarms rates of 25 percent. These predictors would be useful for prioritizing a resource-bound exploration of code that has yet to be inspected
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
(1992) · Cited by 23,431
UCI Repository of machine learning databases
Blake, C. L. (1998) · Medical Entomology and Zoology · Cited by 10,582
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
(1998) · Cited by 3,476
A Practical Approach to Feature Selection
Kira, K., & Rendell, L. A. (1992) · Machine Learning Proceedings 1992 · doi:10.1016/b978-1-55860-247-2.50037-1 · Cited by 2,978
Estimating attributes: Analysis and extensions of RELIEF
Kononenko, I. (1994) · Lecture Notes in Computer Science · doi:10.1007/3-540-57868-4_57 · Cited by 2,958
Software Metrics: A Rigorous and Practical Approach
Fenton, N., & Pfleeger, S. L. (2013) · Cited by 2,509
Halstead, M. H. (1977) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,339
Supervised and Unsupervised Discretization of Continuous Features
Dougherty, J., Kohavi, R., & Sahami, M. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50032-3 · Cited by 1,936
Very Simple Classification Rules Perform Well on Most Commonly Used Datasets
Holte, R. C. (1993) · Machine Learning · doi:10.1023/a:1022631118932 · Cited by 1,791
Design and code inspections to reduce errors in program development
Fagan, M. E. (1976) · IBM Systems Journal · doi:10.1147/sj.153.0182 · Cited by 1,492
Benchmarking attribute selection techniques for discrete class data mining
Hall, M. A., & Holmes, G. (2003) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2003.1245283 · Cited by 1,232
Not So Naive Bayes: Aggregating One-Dependence Estimators
Webb, G. I., Boughton, J. R., & Wang, Z. (2005) · Machine Learning · doi:10.1007/s10994-005-4258-6 · Cited by 708
Quantitative analysis of faults and failures in a complex software system
Fenton, N. E., & Ohlsson, N. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.879815 · Cited by 699
Advances in software inspections
Fagan, M. E. (1986) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1986.6312976 · Cited by 630
Learning Boolean concepts in the presence of many irrelevant features
Almuallim, H., & Dietterich, T. G. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90084-1 · Cited by 520
Machine learning approaches to estimating software development effort
Srinivasan, K., & Fisher, D. (1995) · IEEE Transactions on Software Engineering · doi:10.1109/32.345828 · Cited by 483
Static analysis tools as early indicators of pre-release defect density
Nagappan, N., & Ball, T. (2005) · Proceedings of the 27th international conference on Software engineering - ICSE '05 · doi:10.1145/1062455.1062558 · Cited by 272
Empirically guided software development using metric-based classification trees
Porter, A. A., & Selby, R. W. (1990) · IEEE Software · doi:10.1109/52.50773 · Cited by 264
What we have learned about fighting defects
Shull, F., Basili, V., Boehm, B., Brown, A. W., Costa, P., Lindvall, M., Port, D., Rus, I., Tesoriero, R., & Zelkowitz, M. (2002) · Proceedings Eighth IEEE Symposium on Software Metrics · doi:10.1109/metric.2002.1011343 · Cited by 244
Choosing between two learning algorithms based on calibrated tests
Bouckaert, R. (2003) · Cited by 146
Basili, V. R., McGarry, F. E., Pajerski, R., & Zelkowitz, M. V. (2002) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/581339.581351 · Cited by 135
Fault Prediction Modeling for Software Quality Estimation: Comparing Commonly Used Techniques
Khoshgoftaar, T. M., & Seliya, N. (2003) · Empirical Software Engineering · doi:10.1023/a:1024424811345 · Cited by 128
Shepperd, M., & Ince, D. C. (1994) · Journal of Systems and Software · doi:10.1016/0164-1212(94)90011-6 · Cited by 107
Software verification and validation for practitioners and managers
Rakitin, S. R. (2001) · Cited by 100
Assessing Predictors of Software Defects
Menzies, T., Stefano, J. S. D., & Orrego, A. (2004) · Cited by 88
Self-citationAn application of zero-inflated Poisson regression for software fault prediction
Khoshgoftaar, T. M., Gao, K., & Szabo, R. M. (2005) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.2001.989459 · Cited by 76
How good is your blind spot sampling policy?
Menzies, T., & Stefano, J. S. D. (2004) · IEEE International Symposium on High Assurance Systems Engineering (HASE) · doi:10.1109/hase.2004.1281737 · Cited by 67
Self-citationStatic analysis tools as early indicators of pre-release defect density
Nagappan, N., & Ball, T. (2005) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2005.1553604 · Cited by 65
Menzies, T., Stefano, J. S. D., Chapman, M., & McGill, K. (2004) · IEEE Software Engineering Workshop (SEW) · doi:10.1109/sew.2002.1199449 · Cited by 62
Self-citationDeveloping fault predictors for evolving software systems
Nikora, A. P., & Munson, J. C. (2004) · IEEE International Conference on e-Health Networking, Applications and Services (Healthcom) · doi:10.1109/metric.2003.1232479 · Cited by 60
Noise identification with the k-means algorithm
Tang, W., & Khoshgoftaar, T. M. (2005) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai.2004.93 · Cited by 54
21st-century AI: proud, not smug
Menzies, T. (2003) · IEEE Intelligent Systems · doi:10.1109/mis.2003.1200723 · Cited by 39
Self-citationMenzies, T., Raffo, D., Setamanit, S., Hu, Y., & Tootoonian, S. (2002) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase.2002.1115012 · Cited by 35
Self-citationBasili, V. R., McGarry, F. E., Pajerski, R., & Zelkowitz, M. V. (2003) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.2002.1007957 · Cited by 30
Cited by
Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
A Systematic Literature Review on Fault Prediction Performance in Software Engineering
Hall, T., Beecham, S., Bowes, D., Gray, D., & Counsell, S. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.103 · Cited by 1,154
“Furthermore, a model is only doing any prediction if it is tested on unseen data (i.e. data that was not used during the training process) [[112]].”
On the relative value of cross-company and within-company data for defect prediction
Turhan, B., Menzies, T., Bener, A. B., & Di Stefano, J. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9103-7 · Cited by 725
Self-citationClassifying Software Changes: Clean or Buggy?
Kim, S., Whitehead, & Zhang, Y. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.70773 · Cited by 672
Evaluating defect prediction approaches: a benchmark and an extensive comparison
D’Ambros, M., Lanza, M., & Robbes, R. (2012) · Empirical Software Engineering · doi:10.1007/s10664-011-9173-9 · Cited by 626
Metadata
- Authors
- Menzies, T., Greenwald, J., & Frank, A.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2007-01
- Volume
- 33
- Issue
- 1
- Pages
- 2-13
- ISSN
- 0098-5589 (ISSN-L)
- 1939-3520
- 2326-3881
- OpenAlex
- W3141989311
- Cited by
- 1,215
- References
- 37
- FWCI
- 78.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.