The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Cross versus Within-Company Cost Estimation Studies: A Systematic Review
Abstract
The objective of this paper is to determine under what circumstances individual organizations would be able to rely on cross-company-based estimation models. We performed a systematic review of studies that compared predictions from cross-company models with predictions from within-company models based on analysis of project data. Ten papers compared cross-company and within-company estimation models; however, only seven presented independent results. Of those seven, three found that cross-company models were not significantly different from within-company models, and four found that cross-company models were significantly worse than within-company models. Experimental procedures used by the studies differed making it impossible to undertake formal meta-analysis of the results. The main trend distinguishing study results was that studies with small within-company data sets (i.e., $20 projects) that used leave-one-out cross validation all found that the within-company model was significantly different (better) from the cross-company model. The results of this review are inconclusive. It is clear that some organizations would be ill-served by cross-company models whereas others would benefit. Further studies are needed, but they must be independent (i.e., based on different data bases or at least different single company data sets) and should address specific hypotheses concerning the conditions that would favor cross-company or within-company models. In addition, experimenters need to standardize their experimental procedures to enable formal meta-analysis, and recommendations are made in Section 3.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2000) · Cited by 9,198
Software Engineering Economics
Boehm, B. W. (2001) · Pioneers and Their Contributions to Software Engineering · doi:10.1007/978-3-642-48354-7_5 · Cited by 5,981
(2004) · Cited by 5,198
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Holder, R. L., Mosteller, F., & Tukey, J. W. (1979) · Applied Statistics · doi:10.2307/2346739 · Cited by 1,676
Osborn, J. F., Mosteller, F., & Tukey, J. W. (1978) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344493 · Cited by 1,446
An empirical validation of software cost estimation models
Kemerer, C. F. (1987) · Communications of the ACM · doi:10.1145/22899.22906 · Cited by 896
A General Empirical Solution to the Macro Software Sizing and Estimating Problem
Putnam, L. H. (1978) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1978.231521 · Cited by 800
Software engineering economics: background, current practices, and future directions
Erdogmus, H., Boehm, B. W., Harrison, W., Reifer, D. J., & Sullivan, K. J. (2002) · Proceedings of the 24th international conference on Software engineering - ICSE '02 · doi:10.1145/581441.581444 · Cited by 711
Systematic reviews and meta-analyses: an illustrated, step-by-step guide.
Pai, M., McCulloch, M., Gorman, J. D., Pai, N. P., Enanoria, W. T. A., Kennedy, G., Tharyan, P., & Colford, J. M. (2004) · PubMed · Cited by 521
Controlling Software Projects: Management, Measurement, and Estimates
DeMarco, T. (1982) · Medical Entomology and Zoology · Cited by 495
A simulation study of the model evaluation criterion mmre
Foss, T., Stensrud, E., Kitchenham, B., & Myrtveit, I. (2003) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2003.1245300 · Cited by 480
Self-citationAn assessment and comparison of common software cost estimation modeling techniques
Briand, L. C., El Emam, K., Surmann, D., Wieczorek, I., & Maxwell, K. D. (1999) · Proceedings of the 21st international conference on Software engineering · doi:10.1145/302405.302647 · Cited by 277
A replicated assessment and comparison of common software cost modeling techniques
Briand, L. C., Langley, T., & Wieczorek, I. (2000) · Proceedings of the 22nd international conference on Software engineering - ICSE '00 · doi:10.1145/337180.337223 · Cited by 220
Using public domain metrics to estimate software development effort
Jeffery, R., Ruhe, M., & Wieczorek, I. (2001) · Proceedings Seventh International Software Metrics Symposium · doi:10.1109/metric.2001.915512 · Cited by 186
Jeffery, R., Ruhe, M., & Wieczorek, I. (2000) · Information and Software Technology · doi:10.1016/s0950-5849(00)00153-1 · Cited by 163
A Systematic Review of Cross- vs. Within-Company Cost Estimation Studies
Kitchenham, B. A., Mendes, E., & Travassos, G. H. (2006) · Electronic workshops in computing · doi:10.14236/ewic/ease2006.10 · Cited by 134
Self-citationFurther Comparison of Cross-company and Within-company Effort Estimation Models for Web Applications
Mendes, E., & Kitchenham, B. (2004) · Cited by 133
Self-citationMair, C., & Shepperd, M. (2005) · International Symposium on Empirical Software Engineering · doi:10.1109/isese.2005.1541858 · Cited by 91
Using Genetic Programming to Improve Software Effort Estimation Based on General Data Sets
Lefley, M., & Shepperd, M. (2003) · Lecture notes in computer science · doi:10.1007/3-540-45110-2_151 · Cited by 80
Maxwell, K. D., Wassenhove, L. N. V., & Dutta, S. (1999) · Management Science · doi:10.1287/mnsc.45.6.787 · Cited by 75
Mendes, E., Lokan, C., Harrison, R., & Triggs, C. M. (2005) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metrics.2005.4 · Cited by 65
Self-citationMaking inferences with small numbers of training sets
Kirsopp, C., & Shepperd, M. (2002) · IEE Proceedings - Software · doi:10.1049/ip-sen:20020695 · Cited by 62
How valuable is company-specific data compared to multi-company data for software cost estimation?
Wieczorek, I., & Ruhe, M. (2003) · IEEE International Software Metrics Symposium (METRICS) · doi:10.1109/metric.2002.1011342 · Cited by 57
A comparison of cross-company and within-company effort estimation models for Web applications
Kitchenham, B. A. (2004) · doi:10.1049/ic:20040398 · Cited by 51
Self-citation
Cited by
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
Self-citationSystematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239
“However, a general trend toward more evidence based software engineering (Kitchenham et al. 2004) has lead to an increased focus on new, empirical and systematic research methods.”
Systematic literature reviews in software engineering – A tertiary study
Kitchenham, B., Pretorius, R., Budgen, D., Pearl Brereton, O., Turner, M., Niazi, M., & Linkman, S. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.03.006 · Cited by 1,230
Self-citationOn the relative value of cross-company and within-company data for defect prediction
Turhan, B., Menzies, T., Bener, A. B., & Di Stefano, J. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9103-7 · Cited by 725
Cross-project defect prediction: a large scale experiment on data vs. domain vs. process
Zimmermann, T., Nagappan, N., Gall, H. C., Giger, E., & Murphy, B. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-25785 · Cited by 694
Metadata
- Authors
- Kitchenham, B. A., Mendes, E., & Travassos, G. H.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2007-05
- Volume
- 33
- Issue
- 5
- Pages
- 316-329
- ISSN
- 0098-5589 (ISSN-L)
- OpenAlex
- W2104789242
- Cited by
- 424
- References
- 26
- FWCI
- 10.93
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.