From a Data Science Driven Process to a Continuous Delivery Process for Machine Learning Systems
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The authors considered one academic and eight gray literature items.”
From A Multivocal Review of MLOps Practices, Challenges and Open Issues (2026) · cites this paper as [16]
In the citing paper
“The study discusses tools and techniques used in the CD of ML systems.”
From A Multivocal Review of MLOps Practices, Challenges and Open Issues (2026) · cites this paper as [16]
In the citing paper
“Important details are available concerning the development stages of ML-enabled systems.”
From A Multivocal Review of MLOps Practices, Challenges and Open Issues (2026) · cites this paper as [16]
In the citing paper
“Failures can be a combination of ML infrastructure and software within the MLOps stack [7].”
From Machine Learning Operations (MLOps): Overview, Definition, and Architecture (2023) · cites this paper as [7]
In the citing paper
“Additionally, monitoring of the ML infrastructure, CI/CD, and orchestration are required[7],[23],[24],[28],[32],[33], [50], [α, ζ, η, θ].”
From Machine Learning Operations (MLOps): Overview, Definition, and Architecture (2023) · cites this paper as [7]
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
Software Engineering for Machine Learning: A Case Study
Amershi, S., Begel, A., Bird, C., DeLine, R., Gall, H., Kamar, E., Nagappan, N., Nushi, B., & Zimmermann, T. (2019) · 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · doi:10.1109/icse-seip.2019.00042 · Cited by 1,135
(2015) · neural information processing systems · Cited by 912
Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation
Humble, J., & Farley, D. R. (2010) · Cited by 911
Machine Learning Testing: Survey, Landscapes and Horizons
Zhang, J. M., Harman, M., Ma, L., & Liu, Y. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2962027 · Cited by 897
Garousi, V., Felderer, M., & Mäntylä, M. V. (2019) · Information and Software Technology · doi:10.1016/j.infsof.2018.09.006 · Cited by 831
Huber, S., Wiemer, H., Schneider, D., & Ihlenfeldt, S. (2019) · Procedia CIRP · doi:10.1016/j.procir.2019.02.106 · Cited by 247
Lwakatare, L. E., Raj, A., Crnkovic, I., Bosch, J., & Olsson, H. H. (2020) · Information and Software Technology · doi:10.1016/j.infsof.2020.106368 · Cited by 241
Self-citationContinuous deployment of software intensive products and services: A systematic mapping study
Rodríguez, P., Haghighatkhah, A., Lwakatare, L. E., Teppola, S., Suomalainen, T., Eskeli, J., Karvonen, T., Kuvaja, P., Verner, J. M., & Oivo, M. (2017) · Journal of Systems and Software · doi:10.1016/j.jss.2015.12.015 · Cited by 240
Self-citationData Management Challenges in Production Machine Learning
Polyzotis, N., Roy, S., Whang, S. E., & Zinkevich, M. (2017) · Proceedings of the 2017 ACM International Conference on Management of Data · doi:10.1145/3035918.3054782 · Cited by 208
Research works printed but not linked: 1
- Wirth, R., Hipp, J.: CRISP-DM: towards a standard process model for data mining. In: Proceedings of the 4th International Conference on the Practical Applications of Knowledge Discovery and Data Mining, January 2000
Cited by
Machine Learning Operations (MLOps): Overview, Definition, and Architecture
Kreuzberger, D., Kühl, N., & Hirschl, S. (2023) · IEEE Access · doi:10.1109/access.2023.3262138 · Cited by 766
“…training job iteration (e.g., training date and time, duration, etc.), including the model specific metadata—e.g., used parameters and the resulting performance metrics, model lineage: data and code used—to ensure the full traceability of experiment runs [26,27,29,32,35] P8 Continuous monitoring.”
BackgroundMethodInfluentialMLOps: A Taxonomy and a Methodology
Testi, M., Ballabio, M., Frontoni, E., Iannello, G., Moccia, S., Soda, P., & Vessio, G. (2022) · IEEE Access · doi:10.1109/access.2022.3181730 · Cited by 114
“The outputs of this stage are components (packages and artifacts) to be deployed in the pre-production/production environment of continuous delivery [75].”
BackgroundAI lifecycle models need to be revised: An exploratory study in Fintech
Haakman, M., Cruz, L., Huijgens, H., & van Deursen, A. (2021) · Empirical Software Engineering · doi:10.1007/s10664-021-09993-1 · Cited by 105
Steidl, M., Felderer, M., & Ramler, R. (2023) · Journal of Systems and Software · doi:10.1016/j.jss.2023.111615 · Cited by 126
Elnour, M., Ahmad, A. M., Abdelkarim, S. B., Fadli, F., & Naji, K. K. (2024) · Building Services Engineering Research and Technology · doi:10.1177/01436244241239290 · Cited by 41
“39 42 From another practical aspect, the implementation process of an AI-based smart manufacturing framework is presented by Shahbazi and Byun.”
Metadata
- Authors
- Lwakatare, L. E., Crnkovic, I., Rånge, E., & Bosch, J.
- Affiliations
- Chalmers University of Technology (SE)
- Ericsson (Sweden) (SE)
- Corresponding author
- Lwakatare, Lucy Ellen
- Venue
- Lecture Notes in Computer Science
- Publisher
- Springer International Publishing
- Published
- 2020
- Pages
- 185-201
- ISSN
- 0302-9743 (ISSN-L)
- 1611-3349
- OpenAlex
- W3107994744
- Cited by
- 28
- References
- 22
- Citations by year
- 2026: 2 · 2025: 8 · 2024: 6 · 2023: 8 · 2022: 2 · 2021: 1 · 2020: 1
- FWCI
- 2.28
- Type
- conference paper
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Lecture notes in computer science (publishedVersion)
- Chalmers Research (Chalmers University of Technology) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Keywords
- machine learning systems, continuous delivery, software engineering for machine learning, data science process, process improvement, telecommunications industry, software development practices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: From a Data Science Driven Process to a Continuous Delivery Process for Machine Learning Systems. https://app.cochat.ai/papers/10.1007/978-3-030-64148-1_12
- The paper
- Lwakatare, L. E., Crnkovic, I., Rånge, E., & Bosch, J. (2020). From a Data Science Driven Process to a Continuous Delivery Process for Machine Learning Systems. Lecture Notes in Computer Science. https://doi.org/10.1007/978-3-030-64148-1_12
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.