The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
The confounding effect of class size on the validity of object-oriented metrics
Abstract
Much effort has been devoted to the development and empirical validation of object-oriented metrics. The empirical validations performed thus far would suggest that a core set of validated metrics is close to being identified. However, none of these studies allow for the potentially confounding effect of class size. We demonstrate a strong size confounding effect and question the results of previous object-oriented metrics validation studies. We first investigated whether there is a confounding effect of class size in validation studies of object-oriented metrics and show that, based on previous work, there is reason to believe that such an effect exists. We then describe a detailed empirical methodology for identifying those effects. Finally, we perform a study on a large C++ telecommunications framework to examine if size is really a confounder. This study considered the Chidamber and Kemerer metrics and a subset of the Lorenz and Kidd metrics. The dependent variable was the incidence of a fault attributable to a field failure (fault-proneness of a class). Our findings indicate that, before controlling for size, the results are very similar to previous studies. The metrics that are expected to be validated are indeed associated with fault-proneness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Limited-dependent and qualitative variables in econometrics
Maddala, G. S. (1983) · Cambridge University Press eBooks · doi:10.1017/cbo9780511810176 · Cited by 13,240
Applied Linear Statistical Models
Ziegel, E. R., Neter, J., Wasserman, W., & Kutner, M. (1992) · Technometrics · doi:10.2307/1269588 · Cited by 9,907
Software engineering: A practitioner's approach
(1983) · Advances in Engineering Software (1978) · doi:10.1016/0141-1195(83)90118-3 · Cited by 8,234
Kupper, L. L., Hosmer, D. W., & Lemeshow, S. (1990) · Journal of the American Statistical Association · doi:10.2307/2290035 · Cited by 7,599
Statistical Methods in Cancer Research
Breslow, N. E. (1980) · Cited by 7,332
Regression Diagnostics: Identifying Influential Data and Sources of Collinearity
Belsley, D. A., Kuh, E., & Welsch, R. E. (1980) · Wiley Series in Probability and Statistics · doi:10.1002/0471725153 · Cited by 7,297
Regression Diagnostics -- Identifying Influential Data and Sources of Collinearity
Beaumont, C. D., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981) · The Journal of the Operational Research Society · doi:10.2307/2581267 · Cited by 6,359
Robust Regression and Outlier Detection
Piepel, G. F. (1989) · Technometrics · doi:10.1080/00401706.1989.10488524 · Cited by 6,144
A note on a general definition of the coefficient of determination
NAGELKERKE, N. J. D. (1991) · Biometrika · doi:10.1093/biomet/78.3.691 · Cited by 5,927
A metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,669
Robust Regression and Outlier Detection
Rousseeuw, P. J., & Leroy, A. M. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/0471725382 · Cited by 5,609
Applied Linear Statistical Models.
Lorenz, F., Neter, J., Wasserman, W., & Kutner, M. H. (1986) · Journal of the American Statistical Association · doi:10.2307/2289108 · Cited by 5,565
Statistical methods in cancer research. Volume I - The analysis of case-control studies.
Breslow, N. E., & Day, N. E. (1980) · PubMed · Cited by 4,988
Multiple regression in behavioral research
Kerlinger, F. N., & Pedhazur, E. J. (1973) · Medical Entomology and Zoology · Cited by 4,919
Wiley Series in Probability and Statistics
(2008) · Wiley series in probability and statistics · doi:10.1002/series1345 · Cited by 4,217
Applied Logistic Regression Analysis
(1996) · Technometrics · doi:10.1080/00401706.1996.10484485 · Cited by 3,598
Regression Analysis by Example.
Kmenta, J., Chatterjee, S., & Price, B. (1980) · Journal of the American Statistical Association · doi:10.2307/2287213 · Cited by 3,198
Applied Logistic Regression Analysis
Menard, S. (2002) · Sage eBooks · doi:10.4135/9781412983433 · Cited by 2,989
Epidemiologic Research: Principles and Quantitative Methods.
Mayer, L. S., Kleinbaum, D. G., Kupper, L. L., & Morgenstern, H. (1984) · Journal of the American Statistical Association · doi:10.2307/2288427 · Cited by 2,905
Case-Control Studies: Design, Conduct, Analysis.
Youkeles, L., & Schlesselman, J. J. (1983) · Journal of the American Statistical Association · doi:10.2307/2288156 · Cited by 2,346
Detection of Influential Observation in Linear Regression
Cook, R. D. (2000) · Technometrics · doi:10.2307/1271434 · Cited by 2,269
Epidemiologic Research: Principles and Quantitative Methods.
Pocock, S. J., Kleinbaum, D. G., Kupper, L. L., & Morgenstern, H. (1983) · Biometrics · doi:10.2307/2531133 · Cited by 1,893
Regression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,798
A validation of object-oriented design metrics as quality indicators
Basili, V. R., Briand, L. C., & Melo, W. L. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.544352 · Cited by 1,726
Statistical methods in cancer research. Vol. 1. The analysis of case-control studies
(1983) · Food and Chemical Toxicology · doi:10.1016/0278-6915(83)90281-8 · Cited by 1,716
The Analysis of Contingency Tables
Odoroff, C. L. (1978) · Technometrics · doi:10.1080/00401706.1978.10489678 · Cited by 1,541
Logistic Regression Diagnostics
Pregibon, D. (1981) · The Annals of Statistics · doi:10.1214/aos/1176345513 · Cited by 1,290
Multiple Regression in Behavioral Research
Francis, J. D., Kerlinger, F. N., & Pedhazur, E. J. (1975) · Teaching Sociology · doi:10.2307/1316862 · Cited by 1,282
Applied Logistic Regression Analysis.
Jessen, H. C., & Menard, S. (1996) · The Statistician · doi:10.2307/2988559 · Cited by 1,110
Object-oriented metrics that predict maintainability
Li, W., & Henry, S. (1993) · Journal of Systems and Software · doi:10.1016/0164-1212(93)90077-b · Cited by 1,077
A critique of software defect prediction models
Fenton, N. E., & Neil, M. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.815326 · Cited by 1,040
Regression Analysis by Example: Chatterjee/Regression
Chatterjee, S., & Hadi, A. S. (2006) · Wiley Series in Probability and Statistics · doi:10.1002/0470055464 · Cited by 983
Detection of Influential Observation in Linear Regression
Cook, R. D. (1977) · Technometrics · doi:10.2307/1268249 · Cited by 978
Conditioning Diagnostics: Collinearity and Weak Data in Regression
Goldstein, R. (1993) · Technometrics · doi:10.1080/00401706.1993.10484997 · Cited by 911
Towards a metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1991) · Conference proceedings on Object-oriented programming systems, languages, and applications · doi:10.1145/117954.117970 · Cited by 833
Influential Observations in Linear Regression
Cook, R. D. (1979) · Journal of the American Statistical Association · doi:10.1080/01621459.1979.10481634 · Cited by 830
A unified framework for coupling measurement in object-oriented systems
Briand, L. C., Daly, J. W., & Wust, J. K. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.748920 · Cited by 814
Derksen, S., & Keselman, H. J. (1992) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1992.tb00992.x · Cited by 771
Coefficients of Determination for Multiple Logistic Regression Analysis
Menard, S. (2000) · The American Statistician · doi:10.1080/00031305.2000.10474502 · Cited by 737
Exploring the relationships between design measures and software quality in object-oriented systems
Briand, L. C., Wüst, J., Daly, J. W., & Victor Porter, D. (2000) · Journal of Systems and Software · doi:10.1016/s0164-1212(99)00102-8 · Cited by 710
Quantitative analysis of faults and failures in a complex software system
Fenton, N. E., & Ohlsson, N. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.879815 · Cited by 699
Conditioning Diagnostics: Collinearity and Weak Data in Regression.
Pettit, L., & Belsley, D. A. (1992) · Applied Statistics · doi:10.2307/2348093 · Cited by 570
Towards a framework for software measurement validation
Kitchenham, B., Pfleeger, S. L., & Fenton, N. (1995) · IEEE Transactions on Software Engineering · doi:10.1109/32.489070 · Cited by 550
The Design of Replicated Studies
Lindsay, R. M., & Ehrenberg, A. S. C. (1993) · The American Statistician · doi:10.1080/00031305.1993.10475983 · Cited by 490
A Unified Framework for Cohesion Measurement in Object-Oriented Systems
Briand, L. C., Daly, J. W., & Wüst, J. (1998) · Empirical Software Engineering · doi:10.1023/a:1009783721306 · Cited by 483
Gilb, T. (1977) · Cited by 481
Managerial use of metrics for object-oriented software: an exploratory analysis
Chidamber, S. R., Darcy, D. P., & Kemerer, C. F. (1998) · IEEE Transactions on Software Engineering · doi:10.1109/32.707698 · Cited by 477
Regression analysis by example
Porzio, G. C. (2013) · Journal of Applied Statistics · doi:10.1080/02664763.2013.817041 · Cited by 446
The detection of fault-prone programs
Munson, J. C., & Khoshgoftaar, T. M. (1992) · IEEE Transactions on Software Engineering · doi:10.1109/32.135775 · Cited by 442
Regression Analysis by Example.
Woodward, P. W., Chatterjee, S., & Price, B. (1994) · The Statistician · doi:10.2307/2348349 · Cited by 429
A Comparison of the J-lntegral and CTOD Parameters for Short Crack Specimen Testing
Sorem, W., Dodds, R., & Rolfe, S. (1991) · Elastic-Plastic Fracture Test Methods: The User's Experience (Second Volume) · doi:10.1520/stp16845s · Cited by 392
The Analysis of Contingency Tables
Everitt, B. S. (1992) · doi:10.1201/b15072 · Cited by 388
A Guide to using the collinearity diagnostics
Belsley, D. A. (1991) · Computer Science in Economics and Management · doi:10.1007/bf00426854 · Cited by 357
Predicting fault-prone software modules in telephone switches
Ohlsson, N., & Alberg, H. (1996) · IEEE Transactions on Software Engineering · doi:10.1109/32.553637 · Cited by 346
An investigation into coupling measures for C++
Briand, L., Dévanbu, P., & Melo, W. L. (1997) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/253228.253367 · Cited by 328
Object-Oriented Software Metrics
Polgar, J. (2005) · IGI Global eBooks · doi:10.4018/978-1-59140-553-5.ch379 · Cited by 318
Case-Control Studies. Design, Conduct, Analysis.
Rossiter, C. E., & Schlesselman, J. J. (1983) · Biometrics · doi:10.2307/2531131 · Cited by 310
Experience with the accuracy of software maintenance task effort prediction models
Jorgensen, M. (1995) · IEEE Transactions on Software Engineering · doi:10.1109/32.403791 · Cited by 288
Evaluating the impact of object-oriented design on software quality
Brito e Abreu, F., & Melo, W. (2002) · Proceedings of the 3rd International Software Metrics Symposium · doi:10.1109/metric.1996.492446 · Cited by 273
Schaefer, R. L., Roi, L. D., & Wolfe, R. A. (1984) · Communications in Statistics - Theory and Methods · doi:10.1080/03610928408828664 · Cited by 267
A unified framework for cohesion measurement in object-oriented systems
Briand, L., Daly, J. W., & Wüst, J. (1997) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.1997.637164 · Cited by 261
An empirical investigation of an object-oriented software system
Cartwright, M., & Shepperd, M. (2000) · IEEE Transactions on Software Engineering · doi:10.1109/32.879814 · Cited by 253
Software metrics: successes, failures and new directions
Fenton, N. E., & Neil, M. (1999) · Journal of Systems and Software · doi:10.1016/s0164-1212(99)00035-7 · Cited by 250
Object-Oriented Software Engineering: Measuring And Controlling The Development Process
Abreu, F. B. E., & Carapuça, R. (1994) · doi:10.5281/zenodo.1217608 · Cited by 235
Investigating quality factors in object-oriented designs: an industrial case study
Briand, L. C., Wüst, J., Ikonomovski, S. V., & Lounis, H. (1999) · Proceedings of the 21st international conference on Software engineering · doi:10.1145/302405.302654 · Cited by 235
Software complexity measurement
Kearney, J. P., Sedlmeyer, R. L., Thompson, W. B., Gray, M. A., & Adler, M. A. (1986) · Communications of the ACM · doi:10.1145/7538.7540 · Cited by 192
Measuring the Coupling and Cohesion of an Object-Oriented Program Based on Information Flow
Lee, Y. S. (1995) · Cited by 187
Briand, L. C., Brasili, V. R., & Hetmanski, C. J. (1993) · IEEE Transactions on Software Engineering · doi:10.1109/32.256851 · Cited by 179
An Improper Use of Statistical Significance Testing in Studying Covariables
DALES, L. G., & URY, H. K. (1978) · International Journal of Epidemiology · doi:10.1093/ije/7.4.373 · Cited by 169
A comparison of the comprehension of object-oriented and procedural programs by novice programmers
Wiedenbeck, S., Ramalingam, V., Sarasamma, S. T., & Corritore, C. L. (1999) · Interacting with Computers · doi:10.1016/s0953-5438(98)00029-0 · Cited by 155
A Comment on the Coefficient of Determination for Binary Responses
Cox, D. R., & Wermuth, N. (1992) · The American Statistician · doi:10.1080/00031305.1992.10475836 · Cited by 154
Wax, Y. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111003 · Cited by 120
An empirical view of inheritance
Cartwright, M. (1998) · Information and Software Technology · doi:10.1016/s0950-5849(98)00105-0 · Cited by 115
Support for maintaining object-oriented programs
Lejter, M., Meyers, S., & Reiss, S. P. (1992) · IEEE Transactions on Software Engineering · doi:10.1109/32.184759 · Cited by 92
Briand, L., Arisholm, E., Counsell, S., Houdek, F. G., & Thévenod-Fosse, P. (1999) · Empirical Software Engineering · doi:10.1023/a:1009825923070 · Cited by 91
Theoretical and Empirical Validation of Software Product Measures
Briand, L., Emam, K. E., Morasca, S., et al. (1995) · Cited by 70
Effort estimation and prediction of object-oriented systems
Nesi, P., & Querci, T. (1998) · Journal of Systems and Software · doi:10.1016/s0164-1212(97)10021-8 · Cited by 70
Evaluating predictive quality models derived from software measures: Lessons learned
Lanubile, F., & Visaggio, G. (1997) · Journal of Systems and Software · doi:10.1016/s0164-1212(96)00153-7 · Cited by 62
Polymorphism measures for early risk prediction
Benlarbi, S., & Melo, W. L. (1999) · Proceedings/Proceedings - International Conference on Software Engineering · doi:10.1145/302405.302652 · Cited by 54
Self-citationUsing process history to predict software quality
Khoshgoftaar, T. M., Allen, E. B., Halstead, R., Trio, G. P., & Flass, R. M. (1998) · Computer · doi:10.1109/2.666844 · Cited by 52
Characterizing and modeling the cost of rework in a library of reusable software components
Basili, V. R., Condon, S., Emam, K. E., Hendrick, R., & Melo, W. L. (1997) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/253228.253289 · Cited by 47
The role of program structure in software maintenance
Boehm‐Davis, D. A., Holt, R. W., & Schultz, A. C. (1992) · International Journal of Man-Machine Studies · doi:10.1016/0020-7373(92)90051-l · Cited by 43
Classification tree models of software quality over multiple releases
Khoshgoftaar, T. M., Allen, E. B., Jones, W. D., & HUDEPOHL, J. P. (2003) · Proceedings/Proceedings - International Symposium on Software Reliability Engineering · doi:10.1109/issre.1999.809316 · Cited by 41
A Review of Experimental Investigations into Object-Oriented Technology
Deligiannis, I., Shepperd, M., Webster, S., & Roumeliotis, Μ. (2002) · Empirical Software Engineering · doi:10.1023/a:1016392131540 · Cited by 39
Modeling and managing risk early in software development
Briand, L., Thomas, W. M., & Hetmanski, C. J. (2002) · doi:10.1109/icse.1993.346056 · Cited by 13
An investigation on the use of machine learned models for estimating correction costs
de Almeida, M. A., Lounis, H., & Melo, W. L. (1998) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.1998.671609 · Cited by 13
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
Cited by
Preliminary guidelines for empirical research in software engineering
Kitchenham, B. A., Pfleeger, S. L., Pickard, L. M., Jones, P. W., Hoaglin, D. C., El Emam, K., & Rosenberg, J. (2002) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2002.1027796 · Cited by 1,510
Self-citationSoftware fault prediction metrics: A systematic literature review
Radjenović, D., Heričko, M., Torkar, R., & Živkovič, A. (2013) · Information and Software Technology · doi:10.1016/j.infsof.2013.02.009 · Cited by 538
Curating GitHub for engineered software projects
Munaiah, N., Kroh, S., Cabrey, C., & Nagappan, M. (2017) · Empirical Software Engineering · doi:10.1007/s10664-017-9512-6 · Cited by 365
Quantifying the Effect of Code Smells on Maintenance Effort
Sjoberg, D. I. K., Yamashita, A., Anda, B. C. D., Mockus, A., & Dyba, T. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.89 · Cited by 316
Olague, H. M., Etzkorn, L. H., Gholston, S., & Quattlebaum, S. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.1015 · Cited by 304
Metadata
- Authors
- El Emam, K., Benlarbi, S., Goel, N., & Rai, S. N.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2001-07
- Volume
- 27
- Issue
- 7
- Pages
- 630-650
- ISSN
- 0098-5589 (ISSN-L)
- OpenAlex
- W2160538621
- Cited by
- 422
- References
- 89
- FWCI
- 34.08
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.