The open-closed principle of modern machine learning frameworks
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Recent advances in computing technologies and the availability of huge volumes of data have sparked a new machine learning (ML) revolution, where almost every day a new headline touts the demise of human experts by ML models on some task. Open source software development is rumoured to play a significant role in this revolution, with both academics and large corporations such as Google and Microsoft releasing their ML frameworks under an open source license. This paper takes a step back to examine and understand the role of open source development in modern ML, by examining the growth of the open source ML ecosystem on GitHub, its actors, and the adoption of frameworks over time. By mining LinkedIn and Google Scholar profiles, we also examine driving factors behind this growth (paid vs. voluntary contributors), as well as the major players who promote its democratization (companies vs. communities), and the composition of ML development teams (engineers vs. scientists). According to the technology adoption lifecycle, we find that ML is in between the stages of early adoption and early majority. Furthermore, companies are the main drivers behind open source ML, while the majority of development teams are hybrid teams comprising both engineers and professional scientists. The latter correspond to scientists employed by a company, and by far represent the most active profiles in the development of ML applications, which reflects the importance of a scientific background for the development of ML frameworks to complement coding skills. The large influence of cloud computing companies on the development of open source ML frameworks raises the risk of vendor lock-in. These frameworks, while open source, could be optimized for specific commercial cloud offerings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537 · cited 14×
“Hence, we developed a Web Scraper to explore data on LinkedIn and Google Scholar, to obtain contributors’ information via their full name, if available on GitHub.”
BackgroundInfluentialSome Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
Predictive Analytics in Information Systems Research1
Shmueli, G., & Koppius, O. R. (2011) · MIS Quarterly · doi:10.2307/23042796 · Cited by 1,328
Challenges of open innovation: the paradox of firm investment in open-source software
West, J., & Gallagher, S. (2006) · R and D Management · doi:10.1111/j.1467-9310.2006.00436.x · Cited by 1,136 · cited 2×
“In this section, we discuss some of the studies that relate to the scope of our work, i. Opensourceasopeninnovation WestandGallagher[19]consider that open source software is a great exemplar of open innovation, because of the freedom to use the resulting technology as well as the collaborative…”
Predictive Analytics in Information Systems Research
Shmueli, G., & Koppius, O. (2010) · doi:10.2139/ssrn.1606674 · Cited by 676
Cited by
PYEVOLVE: Automating Frequent Code Changes in Python ML Systems
Dilhara, M., Dig, D., & Ketkar, A. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00091 · Cited by 46
“This will make it much easier for Python-ML developers—the dominant ecosystem in Python [11]—to keep up with the rapidly advancing ML techniques.”
MethodMenzies, T. (2020) · IEEE Software · doi:10.1109/ms.2019.2954841 · Cited by 43
The Diversity Crisis of Software Engineering for Artificial Intelligence
Adams, B., & Khomh, F. (2020) · IEEE Software · doi:10.1109/ms.2020.2975075 · Cited by 31
Self-citation
Metadata
- Authors
- Braiek, H. B., Khomh, F., & Adams, B.
- Venue
- Proceedings of the 15th International Conference on Mining Software Repositories
- Publisher
- ACM
- Published
- 2018-05-28
- Pages
- 353-363
- OpenAlex
- W2883626290
- Cited by
- 39
- References
- 5
- FWCI
- 3.42
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The open-closed principle of modern machine learning frameworks. https://app.cochat.ai/papers/10.1145/3196398.3196445
- The paper
- Braiek, H. B., Khomh, F., & Adams, B. (2018). The open-closed principle of modern machine learning frameworks. Proceedings of the 15th International Conference on Mining Software Repositories. https://doi.org/10.1145/3196398.3196445
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.