The DOI matches its Crossref record; 115 of the 115 references it cites were found in a registry or an index.
A Systematic Review of Software Development Cost Estimation Studies
Abstract
This paper aims to provide a basis for the improvement of software-estimation research through a systematic review of previous work. The review identifies 304 software cost estimation papers in 76 journals and classifies the papers according to research topic, estimation approach, research approach, study context and data set. A Web-based library of these cost estimation papers is provided to ease the identification of relevant estimation research results. The review results combined with other knowledge provide support for recommendations for future software cost estimation research, including: 1) increase the breadth of the search for relevant studies, 2) search manually for relevant papers within a carefully selected set of journals when completeness is essential, 3) conduct more studies on estimation methods commonly used by the software industry, and 4) increase the awareness of how properties of the data sets impact the results when evaluating estimation methods
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Software Engineering Economics
Boehm, B. W. (2001) · Pioneers and Their Contributions to Software Engineering · doi:10.1007/978-3-642-48354-7_5 · Cited by 5,981
Albrecht, A. J., & Gaffney, J. E. (1983) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1983.235271 · Cited by 1,558
Estimating software project effort using analogies
Shepperd, M., & Schofield, C. (1997) · IEEE Transactions on Software Engineering · doi:10.1109/32.637387 · Cited by 954
Self-citationAn empirical validation of software cost estimation models
Kemerer, C. F. (1987) · Communications of the ACM · doi:10.1145/22899.22906 · Cited by 896
A General Empirical Solution to the Macro Software Sizing and Estimating Problem
Putnam, L. H. (1978) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1978.231521 · Cited by 800
Understanding and controlling software costs
Boehm, B. W., & Papaccio, P. N. (1988) · IEEE Transactions on Software Engineering · doi:10.1109/32.6191 · Cited by 667
Cost models for future software life cycle processes: COCOMO 2.0
Boehm, B., Clark, B., Horowitz, E., Westland, C., Madachy, R., & Selby, R. (1995) · Annals of Software Engineering · doi:10.1007/bf02249046 · Cited by 648
A review of studies on expert estimation of software development effort
Jørgensen, M. (2004) · Journal of Systems and Software · doi:10.1016/s0164-1212(02)00156-5 · Cited by 618
Software development cost estimation approaches — A survey
Boehm, B., Abts, C., & Chulani, S. (2000) · Annals of Software Engineering · doi:10.1023/a:1018991717352 · Cited by 588
Machine learning approaches to estimating software development effort
Srinivasan, K., & Fisher, D. (1995) · IEEE Transactions on Software Engineering · doi:10.1109/32.345828 · Cited by 483
Cited by
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
“A database of cost estimation papers from over 70 journals [16] has been the basis of many of the detailed cost estimation studies authored or co-authored by Jørgensen and the database of 103 software experiments [36] has allowed researchers to assess a number of specific research trends in software experimentation.”
BackgroundInfluentialSystematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239
“Only two reviews (7,8: (Sjøberg et al. 2005, Jørgensen & Shepperd 2007)) focused mainly on classifications and taxonomies and presented frequencies of papers in identified categories through thematic analysis.”
Guidelines for conducting systematic mapping studies in software engineering: An update
Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.03.007 · Cited by 2,669
A Systematic Literature Review on Fault Prediction Performance in Software Engineering
Hall, T., Beecham, S., Bowes, D., Gray, D., & Counsell, S. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.103 · Cited by 1,154
“adapted Jørgensen and Shepperd's [4] methodology.”
GenProg: A Generic Method for Automatic Software Repair
Le Goues, C., Nguyen, T., Forrest, S., & Weimer, W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.104 · Cited by 1,085
Using mapping studies as the basis for further research – A participant-observer case study
Kitchenham, B. A., Budgen, D., & Pearl Brereton, O. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.011 · Cited by 621
Identifying relevant studies in software engineering
Zhang, H., Babar, M. A., & Tell, P. (2011) · Information and Software Technology · doi:10.1016/j.infsof.2010.12.010 · Cited by 557
A systematic review of software fault prediction studies
Catal, C., & Diri, B. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.10.027 · Cited by 530
Systematic literature review of machine learning based software development effort estimation models
Wen, J., Li, S., Lin, Z., Hu, Y., & Huang, C. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.09.002 · Cited by 526
Software development in startup companies: A systematic mapping study
Paternoster, N., Giardino, C., Unterkalmsteiner, M., Gorschek, T., & Abrahamsson, P. (2014) · Information and Software Technology · doi:10.1016/j.infsof.2014.04.014 · Cited by 451
The Impact of Automated Parameter Optimization on Defect Prediction Models
Tantithamthavorn, C., McIntosh, S., Hassan, A. E., & Matsumoto, K. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2018.2794977 · Cited by 415
Evaluating prediction systems in software project estimation
Shepperd, M., & MacDonell, S. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2011.12.008 · Cited by 405
Self-citationApplying Systematic Reviews to Diverse Study Types: An Experience Report
Dyba, T., Dingsoyr, T., & Hanssen, G. K. (2007) · First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) · doi:10.1109/esem.2007.59 · Cited by 391
The Future of Empirical Methods in Software Engineering Research
Sjoberg, D. I. K., Dyba, T., & Jorgensen, M. (2007) · Future of Software Engineering (FOSE '07) · doi:10.1109/fose.2007.30 · Cited by 389
Self-citationA Visual Text Mining approach for Systematic Reviews
Malheiros, V., Hohn, E., Pinho, R., Mendonca, M., & Maldonado, J. C. (2007) · First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) · doi:10.1109/esem.2007.21 · Cited by 329
Samareh Moosavi, S. H., & Khatibi Bardsiri, V. (2017) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2017.01.006 · Cited by 309
Software process improvement in small and medium software enterprises: a systematic review
Pino, F. J., García, F., & Piattini, M. (2008) · Software Quality Journal · doi:10.1007/s11219-007-9038-z · Cited by 274
On the Value of Ensemble Effort Estimation
Kocaguneli, E., Menzies, T., & Keung, J. W. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.111 · Cited by 266
Local versus Global Lessons for Defect Prediction and Effort Estimation
Menzies, T., Butcher, A., Cok, D., Marcus, A., Layman, L., Shull, F., Turhan, B., & Zimmermann, T. (2013) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2012.83 · Cited by 261
Variability in Software Systems—A Systematic Literature Review
Galster, M., Weyns, D., Tofan, D., Michalik, B., & Avgeriou, P. (2014) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2013.56 · Cited by 259
What’s up with software metrics? – A preliminary mapping study
Kitchenham, B. (2010) · Journal of Systems and Software · doi:10.1016/j.jss.2009.06.041 · Cited by 253
Pospieszny, P., Czarnacka-Chrobot, B., & Kobylinski, A. (2018) · Journal of Systems and Software · doi:10.1016/j.jss.2017.11.066 · Cited by 247
Data mining techniques for software effort estimation: a comparative study
Dejaeger, K., Verbeke, W., Martens, D., & Baesens, B. (2012) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2011.55 · Cited by 224
An empirical analysis of data preprocessing for machine learning-based software cost estimation
Huang, J., Li, Y.-F., & Xie, M. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.07.004 · Cited by 223
Developing search strategies for detecting relevant experiments
Dieste, O., Grimán, A., & Juristo, N. (2009) · Empirical Software Engineering · doi:10.1007/s10664-008-9091-7 · Cited by 200
Neural network models for software development effort estimation: a comparative study
Nassif, A. B., Azzeh, M., Capretz, L. F., & Ho, D. (2016) · Neural Computing and Applications · doi:10.1007/s00521-015-2127-1 · Cited by 122
Housing Risk Factors Associated with Respiratory Disease: A Systematic Review
Wimalasena, N. N., Chang-Richards, A., Wang, K. I.-K., & Dirks, K. N. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18062815 · Cited by 91
On using grey literature and google scholar in systematic literature reviews in software engineering
Yasin, A., Fatima, R., Wen, L., Afzal, W., Azhar, M., & Torkar, R. (2020) · IEEE Access · doi:10.1109/access.2020.2971712 · Cited by 85
Reference-based search strategies in systematic reviews
Skoglund, M., & Runeson, P. (2009) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2009.4 · Cited by 71
Rimba, P., Tran, A. B., Weber, I., Staples, M., Ponomarev, A., & Xu, X. (2020) · Information Systems Frontiers · doi:10.1007/s10796-018-9876-1 · Cited by 68
(2007) · doi:10.1049/iet-sen:20060052 · Cited by 67
A visual analysis approach to validate the selection review of primary studies in systematic reviews
Felizardo, K. R., Andery, G. F., Paulovich, F. V., Minghim, R., & Maldonado, J. C. (2012) · Information and Software Technology · doi:10.1016/j.infsof.2012.04.003 · Cited by 60
Borg, M., Tornhill, A., & Mones, E. (2023) · Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering · doi:10.1145/3593434.3593480 · Cited by 18
The Impact of Data Quality on Software Testing Effort Prediction
Radliński, Ł. (2023) · Electronics · doi:10.3390/electronics12071656 · Cited by 8
Technical leverage analysis in the Python ecosystem
Paramitha, R., & Massacci, F. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10355-2 · Cited by 7
Metadata
- Authors
- Jorgensen, M., & Shepperd, M.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2007-01
- Volume
- 33
- Issue
- 1
- Pages
- 33-53
- ISSN
- 0098-5589 (ISSN-L)
- OpenAlex
- W3143822685
- Cited by
- 729
- References
- 115
- FWCI
- 12.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.