A framework to guide the selection and configuration of machine-learning-based data analytics solutions in manufacturing
Open accessAbstract
Users in manufacturing willing to apply machine-learning-based (ML-based) data analytics face challenges related to data quality or to the selection and configuration of proper ML algorithms. Current approaches are either purely empirical or reliant on technical data. This makes understanding and comparing candidate solutions difficult, and also ignores the way it impacts the real application problem. In this paper, we propose a framework to generate analytics solutions based on a systematic profiling of all aspects involved. With it, users can visually and systematically explore relevant alternatives for their specific scenario, and obtain recommendations in terms of costs, productivity, results quality, or execution time.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Nine of these papers (i.e., [2,15,21,29,34,40,[49][50][51]) propose a data analytic solution as part of a CPS or IoT system.
“Nine of these papers (i.e., [2,15,21,29,34,40,[49][50][51]) propose a data analytic solution as part of a CPS or IoT system.”
From A Systematic Review of Data Quality in CPS and IoT for Industry 4.0 (2023) · cites this paper as [50]
The Conclusion describes a framework that recommends and compares machine-learning-based analytics solutions for manufacturing, with a prototype applied to two use cases. It does not describe the framework or those solutions as part of a CPS or IoT system (searched: CPS, cyber-physical system, IoT). (LLM, conf=0.84)
Experimental — accuracy not yet measuredThe most frequently mentioned reasons for data quality issues in the reviewed literature are heterogeneous multiple data sources, sensor malfunctions, network problems, high sampling frequency, and cyber attacks for data tampering.
“The most mentioned reasons are heterogeneous multiple data sources [4,12,30,44,50], sensor malfunctions [15,31,35], network problems (connection failures, communication delays) [16,37,40], high sampling frequency [18], and cyber attacks for data tampering [7,31].”
From A Systematic Review of Data Quality in CPS and IoT for Industry 4.0 (2023) · cites this paper as [50]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The NIST Definition of Cloud Computing
Mell, P., & Grance, T. (2011) · doi:10.6028/nist.sp.800-145 · Cited by 15,338 · see citing works
Statistical Comparisons of Classifiers over Multiple Data Sets
Demšar, J. (2006) · doi:10.5555/1248547.1248548 · Cited by 11,966 · see citing works
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515 · see citing works
Practical Bayesian Optimization of Machine Learning Algorithms
Snoek, J., Larochelle, H., & Adams, R. P. (2012) · arXiv · doi:10.48550/arxiv.1206.2944 · Cited by 6,691 · see citing works
The analytic hierarchy process—what it is and how it is used
Saaty, R. W. (1987) · Mathematical Modelling · doi:10.1016/0270-0255(87)90473-8 · Cited by 5,380 · see citing works
Machine learning: a review of classification and combining techniques
Kotsiantis, S. B., Zaharakis, I. D., & Pintelas, P. E. (2006) · Artificial Intelligence Review · doi:10.1007/s10462-007-9052-3 · Cited by 1,582 · see citing works
Machine learning in manufacturing: Advantages, challenges, and applications
Wuest, T., Weimer, D., Irgens, C., & Thoben, K.-D. (2016) · Production & Manufacturing Research · doi:10.1080/21693277.2016.1192517 · Cited by 1,319 · see citing works
(2015) · neural information processing systems · Cited by 1,305 · see citing works
ParamILS: An Automatic Algorithm Configuration Framework
Hutter, F., Hoos, H. H., Leyton‐Brown, K., & Stützle, T. (2009) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2861 · Cited by 883 · see citing works
Applications of machine learning and rule induction
Pat Langley, B., & Simon, H. A. (1995) · Communications of the ACM · doi:10.1145/219717.219768 · Cited by 505 · see citing works
PMLB: a large benchmark suite for machine learning evaluation and comparison
Olson, R. S., Cava, W. L., Orzechowski, P., Urbanowicz, R. J., & Moore, J. H. (2017) · BioData Mining · doi:10.1186/s13040-017-0154-4 · Cited by 373 · see citing works
Advanced analytics: opportunities and challenges
Bose, R. (2009) · Industrial Management & Data Systems · doi:10.1108/02635570910930073 · Cited by 327 · see citing works
ASlib: A benchmark library for algorithm selection
Bischl, B., Kerschke, P., Kotthoff, L., Lindauer, M., Malitsky, Y., Fréchette, A., Hoos, H. H., Hutter, F., Leyton‐Brown, K., Tierney, K., et al. (2016) · Artificial Intelligence · doi:10.1016/j.artint.2016.04.003 · Cited by 215 · see citing works
Machine-learning techniques and their applications in manufacturing
Pham, D. T., & Afify, A. (2005) · Proceedings of the Institution of Mechanical Engineers Part B Journal of Engineering Manufacture · doi:10.1243/095440505x32274 · Cited by 171 · see citing works
Lieber, D., Stolpe, M., Konrad, B., et al. (2013) · Procedia CIRP · doi:10.1016/j.procir.2013.05.033 · Cited by 119 · see citing works
Using quality function deployment in manufacturing strategic planning
Crowe, T. J., & Cheng, C. (1996) · International Journal of Operations & Production Management · doi:10.1108/01443579610114068 · Cited by 111 · see citing works
Dogan, N., & Tanrıkulu, Z. (2012) · Information Technology and Management · doi:10.1007/s10799-012-0135-8 · Cited by 52 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Westkämper, E., Löffler, C.. Strategien der Produktion: Tech- nologien, Konzepte und Wege in die Praxis. Springer; 2016.
- Rivera, , Meulen, . Gartner says advanced analytics is a top business priority. Newsroom: Press Release 2014;URL: https://www.gartner.com/newsroom/id/2881218.
- Hoos, H.H., Neumann, F., Trautmann, H.. Automated algo- rithm selection and configuration (dagstuhl seminar 16412). In: Dagstuhl Reports; vol. 6. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik; 2017,.
- McAuley, J.J., Leskovec, J.. From amateurs to connoisseurs: Modeling the evolution of user expertise through online reviews. In: Proceedings of the 22Nd International Conference on World Wide Web. WWW '13; New York, NY, USA: ACM; 2013,.
Cited by
Sorted by citations
Xie, J., Sun, L., & Zhao, Y. F. (2025) · Engineering · doi:10.1016/j.eng.2024.04.024 · Cited by 112 · see citing works
A Systematic Review of Data Quality in CPS and IoT for Industry 4.0
Goknil, A., Nguyen, P., Sen, S., Politaki, D., Niavis, H., Pedersen, K. J., Suyuthi, A., Anand, A., & Ziegenbein, A. (2023) · ACM Computing Surveys · doi:10.1145/3593043 · Cited by 68 · see citing works
- Authors
- Villanueva Zacarias, A. G., Reimann, P., & Mitschang, B.
- Affiliations
- University of Stuttgart (DE)
- Venue
- Procedia CIRP
- Publisher
- Elsevier BV
- Published
- 2018
- Volume
- 72
- Pages
- 153-158
- ISSN
- 2212-8271 (ISSN-L)
- OpenAlex
- W2810477621
- Cited by
- 26
- References
- 17
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 5 · 2023: 4 · 2022: 7 · 2021: 2 · 2020: 3 · 2019: 2 · 2018: 1
- FWCI
- 1.65
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Procedia CIRP (publishedVersion, cc-by-nc-nd)
- Funders
- Deutsche Forschungsgemeinschaft
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Digital Transformation in Industry
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- machine learning, data analytics, manufacturing industry, solution selection, algorithm configuration, solution recommendation, data quality, decision support framework
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review