The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Teaching MLOps in Higher Education through Project-Based Learning
Open accessAbstract
Building and maintaining production-grade ML-enabled components is a complex endeavor that goes beyond the current approach of academic education, focused on the optimization of ML model performance in the lab. In this paper, we present a project-based learning approach to teaching MLOps, focused on the demonstration and experience with emerging practices and tools to automatize the construction of ML-enabled components. We examine the design of a course based on this approach, including laboratory sessions that cover the end-to-end ML component life cycle, from model building to production deployment. Moreover, we report on preliminary results from the first edition of the course. During the present year, an updated version of the same course is being delivered in two independent universities; the related learning outcomes will be evaluated to analyze the effectiveness of project-based learning for this specific subject.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Some evidence also indicates improved mental health, resilience, and well-being through the social connections built working within creative collectives19though uncertainties around supporting quieter student personalities exist20.”
From Project based learning framework integrating industry collaboration to enhance student future readiness in higher education (2025) · cites this paper as [20]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Energy and Policy Considerations for Deep Learning in NLP
Strubell, E., Ganesh, A., & McCallum, A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1355 · Cited by 3,684
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 1×
“Model cards were introduced in [12] to provide a structured description of ML models including their intended use cases, ethical considerations, and limitations; they provide a template for the reporting of basic model requirements and characteristics.”
BackgroundA review of project-based learning in higher education: Student outcomes and measures
Guo, P., Saab, N., Post, L. S., & Admiraal, W. (2020) · International Journal of Educational Research · doi:10.1016/j.ijer.2020.101586 · Cited by 2,182
The Goal Question Metric Approach
Basili, V. R., Caldiera, G., & Rombach, H. D. (1994) · Cited by 1,651
Schwartz, R., Dodge, J., Smith, N. A., & Etzioni, O. (2020) · Communications of the ACM · doi:10.1145/3381831 · Cited by 1,647
(2015) · neural information processing systems · Cited by 912
Beyond accuracy: behavioral testing of NLP models with CheckList
Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.442 · Cited by 890
Machine Teaching: A New Paradigm for Building Machine Learning SystemsPreprint
Simard, P. Y., Amershi, S., Chickering, D. M., Pelton, A. E., Ghorashi, S., Meek, C., Ramos, G., Suh, J., Verwey, J., Wang, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.06742 · Cited by 220
Deng, L. (2018) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2762725 · Cited by 205
DevOps for AI – Challenges in Development of AI-enabled Applications
Lwakatare, L. E., Crnković, I., & Bosch, J. (2020) · International Conference on Software, Telecommunications and Computer Networks (SoftCOM) · doi:10.23919/softcom50211.2020.9238323 · Cited by 55
Research works printed but not linked: 2
- 2020, 2020 state of enterprise machine learning, Tech Rep
- kästner, 2020, Teaching software engineering for al-enabled systems, 2020 IEEE/ACM 42nd International Conference on Software Engineering Software Engineering Education and Training (ICSESEET), 45
Cited by
Sorted by citations
Naseer, F., Tariq, R., Alshahrani, H. M., Alruwais, N., & Al-Wesabi, F. N. (2025) · Scientific Reports · doi:10.1038/s41598-025-10385-4 · Cited by 169
“Some evidence also indicates improved mental health, resilience, and well-being through the social connections built working within creative collectives 19 though uncertainties around supporting quieter student personalities exist 20 .”
MLOps Components, Tools, Process, and Metrics: A Systematic Literature Review
Woźniak, A. P., Milczarek, M., & Woźniak, J. (2025) · IEEE Access · doi:10.1109/access.2025.3534990 · Cited by 17
An MLOps Approach for Deploying Machine Learning Models in Healthcare Systems
Mallardi, G., Calefato, F., Quaranta, L., & Lanubile, F. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822603 · Cited by 14
Self-citationTowards green AI-based software systems: an architecture-centric approach (GAISSA)
Martínez‐Fernández, S., Franch, X., & Durán, F. (2023) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa60479.2023.00071 · Cited by 14
Self-citationMLOps in Data Science Projects: A Review
Haertel, C., Staegemann, D. G., Daase, C., Pohl, M., Nahhas, A., & Turowski, K. (2023) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata59044.2023.10386139 · Cited by 15
Training Future Machine Learning Engineers: A Project-Based Course on MLOps
Lanubile, F., Martínez‐Fernández, S., & Quaranta, L. (2023) · IEEE Software · doi:10.1109/ms.2023.3310768 · Cited by 6
Self-citationAddressing Quality Challenges in Deep Learning: The Role of MLOps and Domain Knowledge
del Rey, S., Medina, A., Franch, X., & Martínez‐Fernández, S. (2025) · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN) · doi:10.1109/cain66642.2025.00029 · Cited by 2
Self-citationStudy on Effectiveness of Assessment Methods Involved in Project-Based Learning
Hegde, V., Roshin, C., Bayari, S., Ayush, M., & Yashas, P. (2025) · International Conference on Computing for Sustainable Global Development · doi:10.23919/indiacom66777.2025.11115540 · Cited by 2
Fontão, A., Matsubara, E. T., Mongelli, H., Medeiros, M., Lourenço, C., Martins, H., Cortez, I., & Borges, M. (2023) · Brazilian Symposium on Software Engineering · doi:10.1145/3613372.3614199 · Cited by 3
Тименко, В. (2025) · Scientific Notes of Junior Academy of Sciences of Ukraine · doi:10.51707/2618-0529-2025-32-11 · Cited by 1
Dritsas, E., & Τρίγκα, Μ. (2026) · Computing · doi:10.1007/s00607-026-01675-4 · Cited by 2
Pynblint: A quality assurance tool to improve the quality of Python Jupyter notebooks
Quaranta, L., Calefato, F., & Lanubile, F. (2024) · SoftwareX · doi:10.1016/j.softx.2024.101959 · Cited by 1
Self-citation(2023) · IEEE/ACM International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) · doi:10.1109/icse-seet58685.2023.00004
Using Metrics for Code Smells of ML Pipelines
Costal, D., Gómez, C., del Rey, S., & Martínez‐Fernández, S. (2024) · IEEE International Conference on Software Architecture Companion (ICSA-C) · doi:10.1109/icsa-c63560.2024.00055
Self-citationAzamnouri, A., Koch, N., Bogner, J., & Wagner, S. (2025) · Conference on Software Engineering Education and Training · doi:10.1109/cseet66350.2025.00046 · Cited by 1
Teaching Software Engineering for Artificial Intelligence: An Experience Report
Palomba, F., Voria, G., Parziale, A., Pentangelo, V., Porta, A. D., Martino, V. D., Recupito, G., & Giordano, G. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-04207-1_15
The Cost of Teaching Operational ML
Fund, F., Keahey, K., Hammock, C., Richardson, M., Powers, M., & Sherman, M. (2025) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/3731599.3767385
Clements, R. A., & Thiébaut, N. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3786580.3786950
Barth, F. J., Miranda, F., & Graglia, M. A. V. (2026) · Anais do Workshop sobre Educação em Computação (WEI) · doi:10.5753/wei.2026.22373
Fitriani, V., Borhan, M. T., & Tawang, A. (2026) · Jurnal Penelitian Pendidikan IPA · doi:10.29303/jppipa.v12i7.15568
Scaffolding Data-Centric AI: Engineering Patterns and Problem Categories in Undergraduate Projects
Jaros, M., Pitner, T., & Trenz, O. (2026) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-032-32104-6_2
Metadata
- Authors
- Lanubile, F., Martínez-Fernández, S., & Quaranta, L.
- Affiliations
- University of Bari Aldo Moro (IT)
- Universitat Politècnica de Catalunya,Barcelona,Spain
- Venue
- 2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)
- Publisher
- IEEE
- Published
- 2023-05
- Pages
- 95-100
- OpenAlex
- W4383749422
- Cited by
- 21
- References
- 16
- Citations by year
- 2026: 5 · 2025: 8 · 2024: 3 · 2023: 5
- FWCI
- 49.61
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- IEEE/ACM International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- UPCommons institutional repository (Universitat Politècnica de Catalunya) (submittedVersion, cc-by-nc-nd)
- CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro) (submittedVersion)
- arXiv (Cornell University)
- Funders
- European Commission
- Agencia Estatal de Investigación (13039, TED2021-130923B-I00, 10.13039, AEI/10)
- NextGenerationEU
- Topics
- Social Sciences › Education › Problem and Project Based Learning
- Physical Sciences › Computer Science › Information Systems › Information Systems Education and Curriculum Development
- Social Sciences › Education › Engineering Education and Pedagogy
- Keywords
- MLOps, project-based learning, machine learning education, production deployment, model automation, course design, learning outcomes, higher education
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
