The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
An empirical study of open-source and closed-source software products
Abstract
We describe an empirical study of open-source and closed-source software projects. The motivation for this research is to quantitatively investigate common perceptions about open-source projects, and to validate these perceptions through an empirical study. We investigate the hypothesis that open-source software grows more quickly, but does not find evidence to support this. The project growth is similar for all the projects in the analysis, indicating that other factors may limit growth. The hypothesis that creativity is more prevalent in open-source software is also examined, and evidence to support this hypothesis is found using the metric of functions added over time. The concept of open-source projects succeeding because of their simplicity is not supported by the analysis, nor is the hypothesis of open-source projects being more modular. However, the belief that defects are found and fixed more rapidly in open-source projects is supported by an analysis of the functions modified. We find support for two of the five common beliefs and conclude that, when implementing or switching to the open-source development model, practitioners should ensure that an appropriate metrics collection strategy is in place to verify the perceived benefits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raymond, E. (1999) · Knowledge, Technology & Policy · doi:10.1007/s12130-999-1026-0 · Cited by 2,915
VII. Mathematical contributions to the theory of evolution.—III. Regression, heredity, and panmixia
Pearson, K. (1896) · Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character · doi:10.1098/rsta.1896.0007 · Cited by 1,788
Metrics and laws of software evolution-the nineties view
Lehman, M. M., Ramil, J. F., Wernick, P. D., Perry, D. E., & Turski, W. M. (2002) · Proceedings Fourth International Software Metrics Symposium · doi:10.1109/metric.1997.637156 · Cited by 561
Evolution in open source software: a case study
Godfrey, & Tu, Q. (2000) · Proceedings International Conference on Software Maintenance ICSM-94 · doi:10.1109/icsm.2000.883030 · Cited by 542
A case study of open source software development: the Apache server
Mockus, A., Fielding, R. T., & Herbsleb, J. (2000) · Proceedings of the 22nd international conference on Software engineering - ICSE '00 · doi:10.1145/337180.337209 · Cited by 539
An empirical approach to studying software evolution
Kemerer, C. F., & Slaughter, S. (1999) · IEEE Transactions on Software Engineering · doi:10.1109/32.799945 · Cited by 328
Bessen, J. (2006) · The Economics of Open Source Software Development · doi:10.1016/b978-044452769-1/50003-2 · Cited by 292
Lessons from open-source software development
O'Reilly, T. (1999) · Communications of the ACM · doi:10.1145/299157.299164 · Cited by 236
Why Open Source Software / Free Software (OSS/FS, FLOSS, or FOSS)? Look at the Numbers!
Wheeler, D. A. (2005) · Cited by 220
Software evolution observations based on product release history
Gall, H. C., Jazayeri, M., KLÖSCH, R. R., & Trausmuth, G. (1997) · International Conference on Software Maintenance · doi:10.1109/icsm.1997.624242 · Cited by 150
Cited by
MacCormack, A., Rusnak, J., & Baldwin, C. Y. (2006) · Management Science · doi:10.1287/mnsc.1060.0552 · Cited by 718
Free/Libre open-source software development: What we know and what we do not know
Crowston, K., Wei, K., Howison, J., & Wiggins, A. (2012) · ACM Computing Surveys · doi:10.1145/2089125.2089127 · Cited by 455
The Use of MQTT in M2M and IoT Systems: A Survey
Mishra, B., & Kertesz, A. (2020) · IEEE Access · doi:10.1109/access.2020.3035849 · Cited by 429
Sampling in software engineering research: a critical review and guidelines
Baltes, S., & Ralph, P. (2022) · Empirical Software Engineering · doi:10.1007/s10664-021-10072-8 · Cited by 382
The mirroring hypothesis: theory, evidence, and exceptions
Colfer, L. J., & Baldwin, C. Y. (2016) · Industrial and Corporate Change · doi:10.1093/icc/dtw027 · Cited by 331
Metadata
- Authors
- Paulson, J. W., Succi, G., & Eberlein, A.
- Venue
- IEEE Transactions on Software Engineering
- Published
- 2004-04
- Volume
- 30
- Issue
- 4
- Pages
- 246-256
- ISSN
- 0098-5589 (ISSN-L)
- OpenAlex
- W2151187574
- Cited by
- 312
- References
- 13
- FWCI
- 46.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An empirical study of open-source and closed-source software products. https://app.cochat.ai/papers/10.1109/tse.2004.1274044
- The paper
- Paulson, J. W., Succi, G., & Eberlein, A. (2004). An empirical study of open-source and closed-source software products. IEEE Transactions on Software Engineering. https://doi.org/10.1109/tse.2004.1274044
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.