Large-scale machine learning systems in real-world industrial settings: A review of challenges and solutions

Lwakatare, Lucy Ellen, Raj, Aiswarya, Crnkovic, Ivica, Bosch, Jan, Olsson, Helena Holmström·2020·Information and Software Technology
DOI 10.1016/j.infsof.2020.106368

Cited by (241)

Items 101–200 of 241

  1. Optimizing Data Warehousing Performance through Machine Learning Algorithms in the Cloud
    Sina Ahmadi · 2024
  2. Messy Data in Education: Enhancing Data Science Literacy Through Real-World Datasets in a Master’s Program
    Iraklis Varlamis · 2025 · Education Sciences
  3. Leveraging Machine Learning for Sustainable Hotel Management: Predicting Booking Cancellations to Optimize Operations
    Leonidas Theodorakopoulos, Ioanna Kalliampakou, Amalia Ntantou, Constantinos Halkiopoulos · 2025 · Springer proceedings in business and economics
  4. Testing Machine Learning and Deep Learning Systems: Achievements and Challenges
    Salma Albelali, Moataz Ahmed · 2025 · Arabian Journal for Science and Engineering
  5. A Survey of Large-Scale Deep Learning Models in Medicine and Healthcare
    Zhiwei Chen, Runze Liu, Shitao Huang, Yangyang Guo, Yongjun Ren · 2025 · Computer Modeling in Engineering & Sciences
  6. Optimization of Energy-Constrained Task Assignment and Resource Allocation Under End–Edge–Cloud Collaborative Framework
    Gongshu Wang, Guangsen Ling, Lixin Tang · 2025 · IEEE Internet of Things Journal
  7. Learning-Based Difficulty Calibration for Enhanced Membership Inference Attacks
    Haonan Shi, Tu Ouyang, An Wang · 2024 · IEEE European Symposium on Security and Privacy
  8. MultiFuseYOLO: Redefining Wine Grape Variety Recognition through Multisource Information Fusion
    Jialiang Peng, Cheng Ouyang, Hao Ming Peng, Wenwu Hu, Yi Wang, Ping Jiang · 2024 · Sensors
  9. LSPR23: A novel IDS dataset from the largest live-fire cybersecurity exercise
    Allard Dijk, Maj. Emre Halisdemir, Cosimo Melella, Alari Schu, Mauno Pihelgas, Roland Meier · 2024 · Journal of Information Security and Applications
  10. Application of Recurrent Neural Networks for Predictive Modeling of Electrical Submersible Pumps in Oil Extraction
    Carine Menezes Rebello, Érbet Almeida Costa, Odilon S.L. de Abreu, Galdir Reges, Vinícius Viena, Tefilo Paiva Guimares Mendes, Márcio Fontana, Francisco Raphael Ribeiro Bacellar, Marcos Pellegrini Ribeiro, Bernardo Pereira Foresti et al. · 2025 · IFAC-PapersOnLine
  11. ADVANCED FABRICATION AND CHARACTERIZATION OF SILVER NANOPARTICLES USING AI TECHNIQUES
    Zainab M. Lafi, Sina M. Matalqah, SHERINE ASHA, Nisreen Asha, Hala Mhaidat, Sara Yousef Asha · 2025 · International Journal of Applied Pharmaceutics
  12. AI-Generated Machine Learning Models: Towards an Era of Self-Evolving Intelligence
    Shankar Nayak Bhukya, P Raveendra Babu, Errabelli Annapoorna, Amireddy Srinish Reddy, K. Anitha, Justin Mathew · 2025 · International Conference on Metaverse and Current Trends in Computing (ICMCTC)
  13. Artificial Intelligence in the synthesis and application of advanced dental biomaterials: a narrative review of probabilities and challenges
    Dania Hany Elazzouni, Hanan Alsunbul, Raid Abdullah Almnea, Wael Awadh, Abdulrahman Saleh Alshehri, Hind Alhaidry, Ravish Javed, Aftab Ahmed Khan · 2026 · REVIEWS ON ADVANCED MATERIALS SCIENCE
  14. The Efficacy of Autoencoders in the Utilization of Tabular Data for Classification Tasks
    Aizhan Altaibek, Il’murat Tokhtakhunov, Marat Nurtas, Dinara Kozhamzharova, Murat Aitimov · 2024 · Procedia Computer Science
  15. Landslide risk assessment using an integrated framework of machine learning algorithms and multi-criteria decision analysis
    Hang Ha, Chinh Luu, Quynh Duy Bui, Viet‐Phuong Nguyen, Ngoc Tru Vu, Matthieu Kervyn · 2025 · Natural Hazards
  16. The Intersection of Usability Evaluation and Machine Learning in Software Systems
    Richard Torres-Molina, Mohammed Seyam · 2023 · IEEE International Conference on Cognitive Machine Intelligence (CogMI)
  17. Technical risk model of machine learning based software project development - A multinational empirical study using modified Delphi-AHP method
    Ching-Te Lin, Sun-Jen Huang · 2024 · Information and Software Technology
  18. Addressing Threats to Validity in Supervised Machine Learning: A Framework and Best Practices for Education Researchers
    Kylie Anglin · 2024 · AERA Open
  19. Gamified Engagement for Data Crowdsourcing and AI Literacy: An Investigation in Affective Communication Through Speech Emotion Recognition
    Eleni Siamtanidou, Lazaros Vrysis, Nikolaos Vryzas, Charalampos A. Dimoulas · 2025 · Societies
  20. Naming the Pain in machine learning-enabled systems engineering
    Marcos Kalinowski, Daniel Méndez, Görkem Giray, Antônio Pedro Santos Alves, Kelly Azevedo, Tatiana Escovedo, Hugo Villamizar, Hélio Lopes, María Teresa Baldassarre, Stefan Wagner et al. · 2025 · Information and Software Technology
  21. Test Maintenance for Machine Learning Systems: A Case Study in the Automotive Industry
    Lukas Berglund, Tim Grube, Gregory Gay, Francisco Gomes de Oliveira Neto, Dimitrios Platis · 2023 · IEEE International Conference on Software Testing, Verification and Validation (ICST)
  22. Toward a Method Engineering Framework for Project Management and Machine Learning
    Murat Paşa Uysal · 2023 · IEEE Annual International Computer Software and Applications Conference (COMPSAC)
  23. Riding a bicycle while building its wheels: the process of machine learning-based capability development and IT-business alignment practices
    T. Mucha, Si-Jia Ma, K. Abhari · 2023 · Internet Research
  24. Multimodal Deep Learning for Y ouTube Stand-Up Comedy Transcription in Indonesian Language
    Supriyono Supriyono, Aji Prasetya Wibawa, Suyono Suyono, Fachrul Kurniawan · 2025 · International Conference on Knowledge and Smart Technology
  25. Maturity Framework for Enhancing Machine Learning Quality
    A. Castelli, Georgios Christos Chouliaras, Dmitri Goldenberg · 2025 · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)
  26. Reinforcement learning in the context of container terminals
    Merve ÇOLAK, Leonard Heilig, Stefan Voß · 2025 · Flexible Services and Manufacturing Journal
  27. Recent Trends in Machine Learning for Healthcare Big Data Applications: Review of Velocity and Volume Challenges
    Doaa Yaseen Khudhur, Abdul Samad Shibghatullah, Khalid Shaker, Aliza Abdul Latif, Zakaria Che Muda · 2025 · Algorithms
  28. Evolve the Model Universe of a System Universe
    Tao Yue, Shaukat Ali · 2023 · IEEE/ACM International Conference on Automated Software Engineering (ASE)
  29. Tensor Flow-powered Spam Email Filtering: An Evaluation of Performance and Robustness
    Rajendra Kankrale · 2024 · Journal of Electrical Systems
  30. A Systemic Approach to Machine Learning Project Management
    Murat Paşa Uysal, Ersin Akturk · 2024 · IEEE Engineering Management Review
  31. The Past, Present, and Future of Research on the Continuous Development of AI
    Steidl, Monika, Ramler, Rudolf, Felderer, Michael · 2024 · 2024 50th Euromicro Conference on Software Engineering and Advanced Applications (SEAA)
  32. The Role of AI in Combatting Extremism and Radicalization on Social Media
    G. Meena, Shrinwantu Raha, P. Selvakumar, MOHIT Mohit, Pamarthi Satyanarayana, Chirayu Vats · 2025 · Advances in social networking and online communities book series
  33. Advanced prediction of spalling in rigid pavements using GBM and GA optimization
    Ali Juma Alnaqbi, Ghazi G. Al-Khateeb, Waleed Zeiada · 2025 · Discover Cities
  34. Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Production
    Luigi Quaranta · 2022 · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)
  35. A Software Engineering Perspective on Building Production-Ready Machine Learning Systems
    Petra Heck, Gerard Schouten, Luís Cruz · 2021 · Advances in business information systems and analytics book series
  36. Margin-based Greedy Shapelet Search for Robust Time Series Classification of Imbalanced Data
    Thomas Schlegl, Stefan Schlegl, Amelie Sciberras, Nikolai West, Jochen Deuse · 2021 · IEEE International Conference on Big Data (BigData)
  37. Advances in Electron Microscopy with Deep Learning
    Jeffrey M. Ede · 2020 · Warwick Research Archive Portal (University of Warwick)
  38. Design Methods and Processes for ML/DL models
    Meenu Mary John · 2021
  39. More Engineering, No Silos: Rethinking Processes and Interfaces in Collaboration between Interdisciplinary Teams for Machine Learning Projects.
    Nadia Nahar, Shurui Zhou, Grace A. Lewis, Christian Kästner · 2021 · arXiv (Cornell University)
  40. Counterfactual Generation Through Multi-objective Constrained Optimisation
    Wellington Rodrigo Monteiro, Gilberto Reynoso-Meza · 2022 · Research Square
  41. IDENTIFYING CONCERNS WHEN SPECIFYING MACHINE LEARNING-ENABLED SYSTEMS: A PERSPECTIVE-BASED APPROACH
    Hugo Villamizar · 2023
  42. Requirements Modeling
    Murat Paşa Uysal · 2023 · Advances in systems analysis, software engineering, and high performance computing book series
  43. Industrial Maturity of Machine Learning Solutions Within the Food Industry
    Laura Gradl, Luisa Reis, Ricardo Buettner · 2025 · IEEE Access
  44. Why does machine learning work really well in many engineering problems?
    Mohannad Zeyad Naser · 2025 · Machine learning for computational science and engineering
  45. Hierarchical multi-label classification for concrete defects: An industrial case study at Vermeg
    Montassar Ben Messaoud, Ahmed Nour, Ilyes Ben Khalifa, Mohamed Tounsi, Mohamed Wiem Mkaouer · 2025 · Journal of Systems and Software
  46. Dataism, skepticism, and intuition for interpretable machine learning
    Mohannad Zeyad Naser · 2025 · AI and Ethics
  47. An AI-Based Security Analysis Solution for DevSecOps
    Abdullah Al Noman, Samson Olugbenga Idowu, Rolly Davany Mougoue Kakanou, Paolo Ciancarini, Mengfei Ren · 2025 · Lecture notes in networks and systems
  48. Unlocking IIoT Potential: A Systematic Review of AI Applications, Adoption Drivers, and Implementation Barriers
    Tinashe Magara, Mampilo M. Phahlane · 2026 · Applied AI Letters
  49. Harnessing artificial intelligence for global portfolio management: enhancing agile practices in diverse enterprise environments
    Rhytheema Dulloo · 2026 · Elsevier eBooks
  50. A new quantum AI -performance analysis of low-power VLSI circuits in IoT devices using quantum machine learning techniques
    Md Manan Mujahid, Deepa Jose · 2026 · Quantum Information Processing
  51. A comprehensive review on advancements and challenges of deep learning in tunnel and underground engineering
    Chunlei Zhang, Md Habibullah, Jingke Wu, Mahabub Hasan Sajib, Arifuggaman Arif, Mohammed Alip, Boyina Manohar, Golam Mostakim Shikhon, Mingjie Feng, Ye Zhang et al. · 2026 · Discover Artificial Intelligence
  52. LARK: License analysis with RAG and knowledge graphs
    Ilyes Ben Khalifa, Montassar Ben Messaoud, Mohamed Wiem Mkaouer · 2026 · Information and Software Technology
  53. Investigating Vulnerabilities and Potential Security Threats in Current Synthetic Data Generation and Usage in the Automotive Domain
    Swapnil Nandanwar, Sumitra Biswal, Vishal Gupta · 2024 · IEEE International Conference on Omni-layer Intelligent Systems (COINS)
  54. INTEGRATION OF ARTIFICIAL INTELLIGENCE INTO THE CORPORATE MANAGEMENT SYSTEM
    Yevheniia Khaustova, Т. В. Рябокiнь · 2024 · ECONOMICS FINANCE AND MANAGEMENT REVIEW
  55. A formal and integrated approach to engineering machine learning processes: A method base for project management
    Murat Paşa Uysal · 2025 · Turkish Journal of Engineering
  56. A Metrics-Oriented Architectural Model to Characterize Complexity on Machine Learning-Enabled Systems
    Renato Cordeiro Ferreira · 2025 · IEEE/ACM International Conference on AI Engineering – Software Engineering for AI (CAIN)
  57. Minds Out of Matter: Imperatives for Artificial Consciousness
    Isaac Mao, Sidharta Chatterjee · 2025 · The IUP Journal of Knowledge Management
  58. Cross-scale systematic learning for social big data: theory and methods
    Zhiming Zheng, Jinhu Lv, Liang Wang, Renquan Lu, Peng CUI, Xin WANG, Wei Wei · 2024 · Scientia Sinica Informationis
  59. Runtime Verification for Visual Deep Learning Systems With Loss Prediction
    Birk Torpmann-Hagen, Michael Alexander Riegler, Pål Halvorsen, Dag Johansen · 2025 · IEEE Access
  60. Narrative Machines
    Andi Asrifan, Muh. Fadli Hasa, Syafryadin Syafryadin, Hanafi Pelu · 2025 · Advances in computational intelligence and robotics book series
  61. Bridging the Digital Divide in Rural Areas
    Amit Kohli, Tanvir Singh · 2025 · Advances in wireless technologies and telecommunication book series
  62. Effective Automation to Support the Human Infrastructure in AI Red Teaming
    Alice Qian Zhang, Jina Suh, Mary L. Gray, Hong Shen · 2025 · interactions
  63. Automating MLOps Pipelines with GitHub Actions and Azure: A Case Study on Diabetes Prediction
    Lokesh Kumar Chikkala, Nishanth Kumar Pathi, Shinu Abhi · 2025 · International Conference on Emerging Technologies in Computing and Communication (ETCC)
  64. Enhanced Naïve Bayes Model for Intelligent and Secure Email Spam Detection Using Hybrid Feature Engineering and Blockchain-Based Verification
    R Vishwa, D. Kamalin, S. Vanaja, C H Ramesh, Karuna Gotlur, G. Sabarinathan · 2025 · International Conference on Metaverse and Current Trends in Computing (ICMCTC)
  65. Model-Driven Integration of Domain Knowledge into Machine Learning Workflows: A Case for Multidisciplinary System Design
    Neeraj Katiyar, Jhelum Chakravorty · 2025 · IEEE International Requirements Engineering Conference Workshops (REW)
  66. Data-Driven Detection and Prediction of Crop Diseases and Pests Using Machine Learning Techniques
    Anupam Bonkra, Pardeep SinghTiwana, Sandeep Sharma, Sandeep Singh Sandhu, Aakanksha Pundir · 2026 · Communications in computer and information science
  67. An improved crested porcupine optimizer with applications to UAV swarm path planning in complex environments
    Yahong Zhai, Xingtong Hang, Mao Xi, Yifei Zhang, Longyan Xu, Yangbing Zheng · 2026 · The Journal of Supercomputing
  68. Solving high-dimensional global optimization problems via solution space restructuring with neural network
    N. Vo, Thang Le-Duc, H. Tang, Hung Nguyen‐Xuan, S. H. Lee, J. H. Lee · 2026 · Applied Mathematics and Mechanics
  69. Explainable ai-driven triple adaptive feature selection model for enhanced telecom churn prediction
    Danish Javed, N Z Jhanjhi, Najma Imtiaz Ali · 2026 · Results in Engineering
  70. Operationalising an End-to-End MLOps Lifecycle for Energy Forecasting: Implementation and Controlled Evaluation on ClearML
    Xun Zhao, Zheng Grace Ma, Bo Nørregaard Jôrgensen · 2026 · Information
  71. When sensing meets computational Intelligence: A comprehensive survey on pipeline damage detection and localization
    Salman Khalid, Graham Bell, Curt Wolf, John Norton, Sherif El‐Tawil · 2026 · Advanced Engineering Informatics
  72. Specific Aspects of Software Development Process for AI/ML-based Systems
    Віра Вікторівна Любченко · 2022 · IEEE International Conference on Computer Sciences and Information Technologies (CSIT)
  73. Data Handling for Assuring Production Quality of Image Intensive Autonomous Drive Systems: An Industrial Case Study
    Sushant Kumar Pandey, Vasilii Mosin, Darko Durisic, Ashok Chaitanya Koppisetty, Miroslaw Staron · 2023 · Journal of Software Engineering for Autonomous Systems
  74. Towards heart infarction detection via image-based dataset and three-stream fusion framework
    Chuyi Zhong, Dingkang Yang, Shunli Wang, Lihua Zhang · 2023 · Computer Communications
  75. A Model of Factors Influencing the Implementation of Artificial Intelligent in Crisis Management: A Case Study of National Crisis and Emergency Management Authority (NCEMA)
    Ahmed Saeed Ali Rashed Aladawi, Ahmad Nur Aizat Ahmad · 2023 · International Journal of Sustainable Construction Engineering Technology
  76. Efficient Deployment of Machine Learning Models in Manufacturing and Industrial Environments using ROS
    Marvin Frisch, Jan Baumgärtner, Imanuel Heider, Alexander Puchta, Jürgen Fleischer · 2024 · Procedia CIRP
  77. Optimizing Carbon Emissions in Electricity Markets: A System Engineering and Machine Learning Approach
    Zhiyu An, Clifford Alan Whitcomb · 2024 · Systems
  78. Machine Learning-Driven Cryptocurrency Price Forecasting: Advanced Predictive Analytics for Market Trend Modeling
    Saad Hameed, Danial Javaheri, Waqas Naseem · 2025 · International Journal of Computer Applications
  79. An Enterprise Integration Method for Machine Learning-Driven Business Systems
    Murat Paşa Uysal · 2022 · Advances in business information systems and analytics book series
  80. REQUIREMENTS ENGINEERING FOR ML-ENABLED SYSTEMS: STATUS QUO AND PROBLEMS
    Antônio Pedro Santos Alves · 2023
  81. Rapid Selection of Machine Learning Models Using Greedy Cross Validation
    Daniel S. Soper · 2022 · Hawaii International Conference on System Sciences (HICSS)
  82. Towards an Evaluation Model to Quantitively Measure Toolchain Interoperability: A Case Study of Digital Hardware Design
    José María Álvarez-Rodríguez, Roy Mendieta, Eduardo Cibrián, Juan Lloréns · 2022 · SSRN Electronic Journal
  83. Improving ML-based information retrieval software with user-driven functional testing and defect class analysis
    Junjie Zhu, Teng Long, Wei Wang, Atif M. Memon · 2022 · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE)
  84. A Survey of Deployment of Artificial Intelligence
    Kaixin Wu · 2023 · International Conference on Internet Technology and Educational Informatization (ITEI)
  85. Risk Model of Machine Learning Based Software Project Development - a Multinational Empirical Study Using Modified Delphi-Ahp Method
    Sun-Jen Huang, Ching-Te Lin · 2023 · SSRN Electronic Journal
  86. Medidas de control interno para preservar la seguridad de los datos dentro de las empresas e-commerce: Una revisión sistemática
    Luis Rolando Lecca-Rengifo, Harrison Jordi Paz-Medrano, Alberto Carlos Mendoza de los Santos · 2023 · Revista de Ciencia Tecnología e Innovación
  87. Efficacy of Machine Learning Techniques in Diagnosing Urinary Tract Infections: A Study Utilizing a Philippine Clinical Dataset
    Gregorius Airlangga · 2024 · Jurnal Informatika Ekonomi Bisnis
  88. Automated feature selection using improved migrating birds optimization for enhanced medical diagnosis
    Naoual El Aboudi, Youness Riouali, Ahmed Reda Maminou, Hassane Jabri, Laïla Benhlima · 2024 · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering
  89. Robust Training on the Edge: Federated vs. Transfer Learning for Computer Vision in Intelligent Transportation Systems
    Sergey Chuprov, Raman Zatsarenko, Dmitrii Korobeinikov, Leon Reznik · 2024 · IEEE World AI IoT Congress (AIIoT)
  90. Machine learning: A multifaceted exploration of trends, regulations, and global impact
    Singh Baidwan Rishwinder, Singh Tusharika, Kumar Santosh, Kumar Rakesh · 2024 · i-manager’s Journal on Future Engineering and Technology
  91. Identification of Saline Soybean Varieties Based On Trinocular Vision Fusion and Deep Learning
    Hang Liu, Qiong Wu, Guangxia Wu, Dan Zhu, Limiao Deng, Xiaoyang Liu, Zhongzhi Han, Longgang Zhao · 2024 · Journal of Plant Diseases and Protection
  92. Assessment of Bimodal Machine Learning framework in predicting air quality index articulated as numerical and text encoded targets over urban centers
    Jagadish Kumar Mogaraju · 2024 · Research Square
  93. Enhancing Software Testing with Machine Learning
    Mouna Mothey · 2023 · International Journal of Scientific Research in Computer Science Engineering and Information Technology
  94. Development of View Optimization Techniques for Structural Monitoring Systems Using Post-Processing of Structural Analysis and Image Processing
    Yonghui Park · 2024 · IEEE Access
  95. Machine Learning Based Explainable Fault Detection of Vacuum Pumps in PV Solar Cell Manufacturing
    Ajay Narayanan, Kedar Kulkarni, Fery Riswan, Muhammad Azzrul Bin Salehan · 2024 · Indian Control Conference
  96. KPAMA: A Kubernetes based tool for Mitigating ML system Aging
    Wenjie Ding, Zhihao Liu, Xuhui Lu, Xiaoting Du, Zheng Zheng · 2025 · Journal of Systems and Software
  97. Bridging the Gap Between Industry and Academic Institutions in India Using Lean and Six Sigma Principles
    M. Thenarasu, Mannepu Venkata Roshan, S. Sujay, Olivia McDermott, Vimal Kumar · 2025 · Lecture notes in management and industrial engineering
  98. The Modern Framework of Digital Supply Chain Management: A Systematic Literature Review
    Ahmad ali · 2025 · SSRN Electronic Journal
  99. AI-Driven Tennis Coaching
    Yujun Ge, Jerry Ng · 2024 · IEEE MIT Undergraduate Research Technology Conference (URTC)
  100. Automating Global Trade Compliance through Product Classification Systems
    Amazon - Seattle, US, Jiten Sardana · 2024 · The American Journal of Management and Economics Innovations