The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Comparing software prediction techniques using simulation
Open accessAbstract
The need for accurate software prediction systems increases as software becomes much larger and more complex. We believe that the underlying characteristics: size, number of features, type of distribution, etc., of the data set influence the choice of the prediction system to be used. For this reason, we would like to control the characteristics of such data sets in order to systematically explore the relationship between accuracy, choice of prediction system, and data set characteristic. It would also be useful to have a large validation data set. Our solution is to simulate data allowing both control and the possibility of large (1000) validation cases. The authors compare four prediction techniques: regression, rule induction, nearest neighbor (a form of case-based reasoning), and neural nets. The results suggest that there are significant differences depending upon the characteristics of the data set. Consequently, researchers should consider prediction context when evaluating competing prediction systems. We observed that the more "messy" the data and the more complex the relationship with the dependent variable, the more variability in the results. In the more complex cases, we observed significantly different results depending upon the particular training set that has been sampled from the underlying data set. However, our most important result is that it is more fruitful to ask which is the best prediction system in a particular context rather than which is the "best" prediction system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · Cited by 23,431
Software Engineering Economics
Boehm, B. W. (2001) · Pioneers and Their Contributions to Software Engineering · doi:10.1007/978-3-642-48354-7_5 · Cited by 5,981
Kolodner, J. L. (2005) · The Cambridge Handbook of the Learning Sciences · doi:10.1017/cbo9780511816833.015 · Cited by 4,247
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Applied linear statistical models : regression, analysis of variance, and experimental designs
Neter, J., Wasserman, W., & Kutner, M. (1974) · Andalas University Repository (Andalas University) · Cited by 2,818
Estimating software project effort using analogies
Shepperd, M., & Schofield, C. (1997) · IEEE Transactions on Software Engineering · doi:10.1109/32.637387 · Cited by 954
Self-citationLearning decision tree classifiers
Quinlan, J. R. (1996) · ACM Computing Surveys · doi:10.1145/234313.234346 · Cited by 504
Learning from examples: generation and evaluation of decision trees for software resource analysis
Selby, R. W., & Porter, A. A. (1988) · IEEE Transactions on Software Engineering · doi:10.1109/32.9061 · Cited by 279
Examining the Feasibility of a Case-Based Reasoning Model for Software Effort Estimation1
Mukhopadhyay, T., Vicinanza, S. S., & Prietula, M. J. (1992) · MIS Quarterly · doi:10.2307/249573 · Cited by 241
A replicated assessment and comparison of common software cost modeling techniques
Briand, L. C., Langley, T., & Wieczorek, I. (2000) · Proceedings of the 22nd international conference on Software engineering - ICSE '00 · doi:10.1145/337180.337223 · Cited by 220
A controlled experiment to assess the benefits of estimating with analogy and regression models
Myrtveit, I., & Stensrud, E. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.799947 · Cited by 183
Estimating software development effort with connectionist models
Wittig, G. E., & Finnie, G. R. (1997) · Information and Software Technology · doi:10.1016/s0950-5849(97)00004-9 · Cited by 120
An investigation of analysis techniques for software datasets
Pickard, L. M., Kitchenham, B. A., & Linkman, S. (2003) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.1999.809734 · Cited by 67
Can results from software engineering experiments be safely combined?
Miller, J. (2003) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.1999.809736 · Cited by 58
An investigation on the use of machine learned models for estimating correction costs
de Almeida, M. A., Lounis, H., & Melo, W. L. (1998) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1109/icse.1998.671609 · Cited by 13
Cited by
Lessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
A systematic review of software development cost estimation studies
Jørgensen, M., & Shepperd, M. (2007) · Brunel University Research Archive (BURA) (Brunel University London) · doi:10.1109/tse.2007.3 · Cited by 742
Self-citationA Systematic Review of Software Development Cost Estimation Studies
Jorgensen, M., & Shepperd, M. (2007) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2007.256943 · Cited by 729
Self-citationAn Empirical Comparison of Model Validation Techniques for Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2017) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2584050 · Cited by 574
Systematic literature review of machine learning based software development effort estimation models
Wen, J., Li, S., Lin, Z., Hu, Y., & Huang, C. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.002 · Cited by 526
Metadata
- Authors
- Shepperd, M., & Kadoda, G.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2001
- Volume
- 27
- Issue
- 11
- Pages
- 1014-1022
- ISSN
- 0098-5589 (ISSN-L)
- OpenAlex
- W2159747233
- Cited by
- 280
- References
- 15
- FWCI
- 21.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.